-
Notifications
You must be signed in to change notification settings - Fork 996
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Model does not train without FP16
bug
Something isn't working
#322
by kipgparker
was closed Jun 16, 2021
ZeRO2 with Pipeline parallelism
feature request
New feature or request
#411
by hyunwoongko
was closed Sep 25, 2021
text_gen_gpt2.py fails with TypeError
bug
Something isn't working
#410
by xynydev
was closed Sep 19, 2021
Index Errors with Weighted Dataset
bug
Something isn't working
#377
by sdtblck
was closed Jul 30, 2021
Changing distillation weights changes runtime
bug
Something isn't working
#372
by StellaAthena
was closed Sep 18, 2022
Eval Harness doesn't log during training
feature request
New feature or request
#366
by StellaAthena
was closed Aug 31, 2021
Using human feedback to train the model
feature request
New feature or request
#344
by bpm246
was closed May 21, 2021
SyntaxError in preprocessing_data.py
bug
Something isn't working
#343
by bpm246
was closed May 21, 2021
Write Sampling Documentation
documentation
Improvements or additions to documentation
#252
by sdtblck
was closed Aug 21, 2021
Integrate lm_evaluation_harness
feature request
New feature or request
#312
by sdtblck
was closed Jun 23, 2021
Add ReLU / other activation fns
feature request
New feature or request
#303
by sdtblck
was closed May 7, 2021
Implement Bf16
feature request
New feature or request
#302
by sdtblck
was closed Jun 22, 2021
1 task
Integrate distilling
feature request
New feature or request
#293
by StellaAthena
was closed Sep 18, 2022
Abort runs if loss scale gets stuck at minimum
feature request
New feature or request
#291
by sdtblck
was closed May 4, 2021
Increase Test Coverage
feature request
New feature or request
#286
by sweinbach
was closed May 12, 2021
Why [seq, batch, heads, hdim] instead of [batch, seq, heads, hdim] ?
#271
by richarddwang
was closed May 3, 2021
Enable custom val/test data
feature request
New feature or request
#263
by StellaAthena
was closed May 9, 2021
Resizing token embeddings to account for new special tokens
feature request
New feature or request
#258
by g-karthik
was closed Sep 29, 2023
Get rid of global_vars
feature request
New feature or request
#254
by sdtblck
was closed Apr 30, 2021
ProTip!
What’s not been updated in a month: updated:<2024-09-06.