-
Notifications
You must be signed in to change notification settings - Fork 996
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Failed to install apex
bug
Something isn't working
#225
by notooth1
was closed Apr 10, 2021
updated Apr 10, 2021
Change corpora to use lm-dataformat
feature request
New feature or request
good first issue
Good for newcomers
#165
by leogao2
was closed Apr 11, 2021
updated Apr 11, 2021
The Something isn't working
main
branch is broken.
bug
#240
by StellaAthena
was closed Apr 18, 2021
updated Apr 18, 2021
Failed to train
bug
Something isn't working
#227
by notooth1
was closed Apr 18, 2021
updated Apr 18, 2021
Fix DeepSpeed (ZeRO2 + Pipeline Parallel)
bug
Something isn't working
help wanted
This issue needs assistance
#67
by StellaAthena
was closed Jan 16, 2021
updated Apr 22, 2021
Ensure Sampling works correctly
experiments
Experiments we wish to perform on the codebase
feature request
New feature or request
#152
by sdtblck
was closed Apr 22, 2021
updated Apr 22, 2021
Error upon finishing a run
bug
Something isn't working
#216
by sdtblck
was closed Apr 25, 2021
updated Apr 25, 2021
Refacturing Config
feature request
New feature or request
#245
by sweinbach
was closed Apr 26, 2021
updated Apr 26, 2021
Add Unit Tests / Style Tests
documentation
Improvements or additions to documentation
feature request
New feature or request
good first issue
Good for newcomers
#221
by sdtblck
was closed Apr 28, 2021
updated Apr 28, 2021
4 tasks
Timer logging innacurate if pp=0
bug
Something isn't working
#238
by sdtblck
was closed Apr 30, 2021
updated Apr 30, 2021
Get rid of codepath where pp = 0
feature request
New feature or request
#243
by sdtblck
was closed Apr 30, 2021
updated Apr 30, 2021
Code Cleanup
documentation
Improvements or additions to documentation
#208
by sdtblck
was closed Apr 30, 2021
updated Apr 30, 2021
3 tasks done
Get rid of global_vars
feature request
New feature or request
#254
by sdtblck
was closed Apr 30, 2021
updated Apr 30, 2021
Why [seq, batch, heads, hdim] instead of [batch, seq, heads, hdim] ?
#271
by richarddwang
was closed May 3, 2021
updated May 3, 2021
Automatic tests
feature request
New feature or request
#278
by sweinbach
was closed May 3, 2021
updated May 3, 2021
Add Madgrad
feature request
New feature or request
#210
by sdtblck
was closed May 3, 2021
updated May 3, 2021
Abort runs if loss scale gets stuck at minimum
feature request
New feature or request
#291
by sdtblck
was closed May 4, 2021
updated May 4, 2021
Bias Gelu Fusion + GEGLU errors
bug
Something isn't working
#237
by sdtblck
was closed May 7, 2021
updated May 7, 2021
Add ReLU / other activation fns
feature request
New feature or request
#303
by sdtblck
was closed May 7, 2021
updated May 7, 2021
Enable custom val/test data
feature request
New feature or request
#263
by StellaAthena
was closed May 9, 2021
updated May 9, 2021
Increase Test Coverage
feature request
New feature or request
#286
by sweinbach
was closed May 12, 2021
updated May 12, 2021
Using human feedback to train the model
feature request
New feature or request
#344
by bpm246
was closed May 21, 2021
updated May 21, 2021
SyntaxError in preprocessing_data.py
bug
Something isn't working
#343
by bpm246
was closed May 21, 2021
updated May 21, 2021
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.