Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

merge from magma #20

Merged
merged 10 commits into from
Jun 13, 2023
Merged

merge from magma #20

merged 10 commits into from
Jun 13, 2023

Commits on May 31, 2023

  1. Add support to HFTokenzer

    floatingsnake committed May 31, 2023
    Configuration menu
    Copy the full SHA
    299f546 View commit details
    Browse the repository at this point in the history

  2. Script to convert GPT Neox Checkpoint for magma

    Kshitij Gupta committed May 31, 2023
    Configuration menu
    Copy the full SHA
    f1810aa View commit details
    Browse the repository at this point in the history

  3. Merge pull request #10 from floatingsnake/neox_checkpoint_loading 

    Script to convert GPT Neox Checkpoint for magma
    @floatingbigcat
    floatingbigcat committed May 31, 2023
    Configuration menu
    Copy the full SHA
    eb4edda View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. add 70mOpenclipH model config for summit

    floatingsnake committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    bef649e View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. rm eod token for hfgpt2tokenizer

    floatingsnake committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    acbc2b2 View commit details
    Browse the repository at this point in the history

  2. add mask for pad token

    floatingsnake committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    cb1e342 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #14 from floatingsnake/fix-maskpad 

    add mask for pad token
    @kshitijkg
    kshitijkg committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    48ceea8 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. add pad token

    floatingsnake committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    29697ad View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2023

  1. Merge branch 'magma' into fix-tokenizer

    @floatingbigcat
    floatingbigcat committed Jun 10, 2023
    Configuration menu
    Copy the full SHA
    5795012 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Merge pull request #9 from floatingsnake/fix-tokenizer 

    Add support to HFTokenzer
    @kshitijkg
    kshitijkg committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    922a26e View commit details
    Browse the repository at this point in the history