Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: EleutherAI/gpt-neox Loading
base: main
Choose a base ref
...
head repository: RaoNikitha/gpt-neox Loading
compare: main
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 10 commits
  • 10 files changed
  • 2 contributors

Commits on Dec 6, 2022

  1. Fix attention type can be both sparse and flash

    @VHellendoorn
    VHellendoorn committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    320f5ac View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. updated data loaders and configs

    @RaoNikitha
    RaoNikitha committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    9b34e2c View commit details
    Browse the repository at this point in the history

  2. resolve merge conflicts

    @RaoNikitha
    RaoNikitha committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    eb23f17 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. updated config

    @RaoNikitha
    RaoNikitha committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    4606dbc View commit details
    Browse the repository at this point in the history

  2. fixed flash attention config

    @RaoNikitha
    RaoNikitha committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    fdbdbab View commit details
    Browse the repository at this point in the history

  3. fixed bug in 2-7B config

    @RaoNikitha
    RaoNikitha committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    d7b1a91 View commit details
    Browse the repository at this point in the history

  4. update 2-7B config

    @RaoNikitha
    RaoNikitha committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    9e5bdc5 View commit details
    Browse the repository at this point in the history

Commits on Dec 24, 2022

  1. updated config

    @RaoNikitha
    RaoNikitha committed Dec 24, 2022
    Configuration menu
    Copy the full SHA
    856ae09 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2023

  1. update training

    @RaoNikitha
    RaoNikitha committed May 6, 2023
    Configuration menu
    Copy the full SHA
    1fc6ad5 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. update pretraining config files

    @RaoNikitha
    RaoNikitha committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    0570a7e View commit details
    Browse the repository at this point in the history
Loading