Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use minimal softmax mask values based on the datatype #966

Merged
merged 6 commits into from
Jun 5, 2023
Merged

Use minimal softmax mask values based on the datatype #966

merged 6 commits into from
Jun 5, 2023

Commits on Apr 27, 2023

  1. added HF to NeoX 2.0 conversion script with mp and pp sharding

    @bentherien
    bentherien committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    3820426 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2023

  1. (1) added missing curly brace to pythial/1-4B config; (2) fixed a bug… 

    … related to a hardcoded value withing the conversion script (3) fixed possible bugs in the conversion script wrt the mp sharding convention
    @bentherien
    bentherien committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    575f706 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. Merge branch 'main' into main

    @Quentin-Anthony
    Quentin-Anthony committed May 18, 2023
    Configuration menu
    Copy the full SHA
    eb8978b View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2023

  1. Merge branch 'main' of https://github.com/bentherien/gpt-neox into main

    @bentherien
    bentherien committed Jun 4, 2023
    Configuration menu
    Copy the full SHA
    f0028c7 View commit details
    Browse the repository at this point in the history

  2. fill in minimal possible mask values

    @bentherien
    bentherien committed Jun 4, 2023
    Configuration menu
    Copy the full SHA
    51864ae View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. initialize tensor on the target device

    @bentherien
    bentherien committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    fab9ccb View commit details
    Browse the repository at this point in the history