-
Notifications
You must be signed in to change notification settings - Fork 981
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add StableLM as an example to the README
documentation
Improvements or additions to documentation
#896
opened Apr 22, 2023 by
StellaAthena
Implement the MPU from Megatron
feature request
New feature or request
#75
by StellaAthena
was closed Feb 15, 2021
Allow for alternative architectures
feature request
New feature or request
#6
by StellaAthena
was closed Jan 4, 2021
Integrate ZeRO-Powered Data Parallelism
feature request
New feature or request
#20
by StellaAthena
was closed Jan 5, 2021
Integrate the full power of ZeRo into the code
feature request
New feature or request
#19
by StellaAthena
was closed Jan 5, 2021
Update documentation
documentation
Improvements or additions to documentation
#27
by StellaAthena
was closed Jan 6, 2021
Implement Gradient Checkpointing
feature request
New feature or request
good first issue
Good for newcomers
#55
by StellaAthena
was closed Jan 12, 2021
Implement 1-Bit Adam
feature request
New feature or request
good first issue
Good for newcomers
#69
by StellaAthena
was closed Jan 23, 2021
Expand to all 8 CoreWeave Machines
feature request
New feature or request
#68
by StellaAthena
was closed Jan 24, 2021
Integrate DeepSpeed
feature request
New feature or request
#4
by StellaAthena
was closed Dec 26, 2020
2
Create experiment runners
feature request
New feature or request
good first issue
Good for newcomers
#7
by StellaAthena
was closed Feb 17, 2021
2 tasks
Fix our configs
experiments
Experiments we wish to perform on the codebase
#133
by StellaAthena
was closed Feb 27, 2021
Figure out why 1-bit Adam pretends to run
bug
Something isn't working
documentation
Improvements or additions to documentation
experiments
Experiments we wish to perform on the codebase
#128
by StellaAthena
was closed Mar 4, 2021
Build PyTorch from source
experiments
Experiments we wish to perform on the codebase
#127
by StellaAthena
was closed Mar 4, 2021
Check if ZeRO-3 is actually slower
bug
Something isn't working
#211
by StellaAthena
was closed Apr 6, 2021
Robust testing suite
feature request
New feature or request
good first issue
Good for newcomers
help wanted
This issue needs assistance
#957
by StellaAthena
was closed Dec 4, 2023
25 tasks
Enable custom val/test data
feature request
New feature or request
#263
by StellaAthena
was closed May 9, 2021
Figure out what’s taking so long to do comms
bug
Something isn't working
experiments
Experiments we wish to perform on the codebase
help wanted
This issue needs assistance
#126
by StellaAthena
was closed Aug 28, 2021
Eval Harness doesn't log during training
feature request
New feature or request
#366
by StellaAthena
was closed Aug 31, 2021
Pipeline parallelism and gradient checkpointing (edit: and ZeRO 2!) don’t work together
bug
Something isn't working
#62
by StellaAthena
was closed Jan 28, 2021
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.