Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Failed to install the requirements
#223 by notooth1 was closed Apr 10, 2021 updated Apr 10, 2021
Failed to install apex bug Something isn't working
#225 by notooth1 was closed Apr 10, 2021 updated Apr 10, 2021
Change corpora to use lm-dataformat feature request New feature or request good first issue Good for newcomers
#165 by leogao2 was closed Apr 11, 2021 updated Apr 11, 2021
The main branch is broken. bug Something isn't working
#240 by StellaAthena was closed Apr 18, 2021 updated Apr 18, 2021
Failed to train bug Something isn't working
#227 by notooth1 was closed Apr 18, 2021 updated Apr 18, 2021
Fix DeepSpeed (ZeRO2 + Pipeline Parallel) bug Something isn't working help wanted This issue needs assistance
#67 by StellaAthena was closed Jan 16, 2021 updated Apr 22, 2021
Ensure Sampling works correctly experiments Experiments we wish to perform on the codebase feature request New feature or request
#152 by sdtblck was closed Apr 22, 2021 updated Apr 22, 2021
docker wandb
#220 by zshyang was closed Apr 24, 2021 updated Apr 24, 2021
Error upon finishing a run bug Something isn't working
#216 by sdtblck was closed Apr 25, 2021 updated Apr 25, 2021
Refacturing Config feature request New feature or request
#245 by sweinbach was closed Apr 26, 2021 updated Apr 26, 2021
Add Unit Tests / Style Tests documentation Improvements or additions to documentation feature request New feature or request good first issue Good for newcomers
#221 by sdtblck was closed Apr 28, 2021 updated Apr 28, 2021
4 tasks
Timer logging innacurate if pp=0 bug Something isn't working
#238 by sdtblck was closed Apr 30, 2021 updated Apr 30, 2021
Get rid of codepath where pp = 0 feature request New feature or request
#243 by sdtblck was closed Apr 30, 2021 updated Apr 30, 2021
Code Cleanup documentation Improvements or additions to documentation
#208 by sdtblck was closed Apr 30, 2021 updated Apr 30, 2021
3 tasks done
Get rid of global_vars feature request New feature or request
#254 by sdtblck was closed Apr 30, 2021 updated Apr 30, 2021
Automatic tests feature request New feature or request
#278 by sweinbach was closed May 3, 2021 updated May 3, 2021
Add Madgrad feature request New feature or request
#210 by sdtblck was closed May 3, 2021 updated May 3, 2021
Abort runs if loss scale gets stuck at minimum feature request New feature or request
#291 by sdtblck was closed May 4, 2021 updated May 4, 2021
Bias Gelu Fusion + GEGLU errors bug Something isn't working
#237 by sdtblck was closed May 7, 2021 updated May 7, 2021
Add ReLU / other activation fns feature request New feature or request
#303 by sdtblck was closed May 7, 2021 updated May 7, 2021
Enable custom val/test data feature request New feature or request
#263 by StellaAthena was closed May 9, 2021 updated May 9, 2021
Increase Test Coverage feature request New feature or request
#286 by sweinbach was closed May 12, 2021 updated May 12, 2021
Using human feedback to train the model feature request New feature or request
#344 by bpm246 was closed May 21, 2021 updated May 21, 2021
SyntaxError in preprocessing_data.py bug Something isn't working
#343 by bpm246 was closed May 21, 2021 updated May 21, 2021
ProTip! Type g i on any issue or pull request to go back to the issue listing page.