Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
54 Open 373 Closed
54 Open 373 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Model does not train without FP16 bug Something isn't working
#322 by kipgparker was closed Jun 16, 2021
1
ZeRO2 with Pipeline parallelism feature request New feature or request
#411 by hyunwoongko was closed Sep 25, 2021
4
text_gen_gpt2.py fails with TypeError bug Something isn't working
#410 by xynydev was closed Sep 19, 2021
2
13B Model Out of Memory with Single Node 8 A100 GPUs
#409 by benathi was closed Dec 11, 2022
14
is correct implementation of gradient accumulation?
#405 by hyunwoongko was closed Sep 7, 2021
Index Errors with Weighted Dataset bug Something isn't working
#377 by sdtblck was closed Jul 30, 2021
1
1
Thank you feature request New feature or request
#376 by qwertyuu was closed Jul 15, 2021
1
Changing distillation weights changes runtime bug Something isn't working
#372 by StellaAthena was closed Sep 18, 2022
@StellaAthena @preethamgali
1
Bugs during Setup bug Something isn't working
#369 by ghost was closed Jul 10, 2021
3
Eval Harness doesn't log during training feature request New feature or request
#366 by StellaAthena was closed Aug 31, 2021
1
Discord invite on README.md is invalid
#358 by ButterscotchV was closed Jun 10, 2021
1
1
Using human feedback to train the model feature request New feature or request
#344 by bpm246 was closed May 21, 2021
1
SyntaxError in preprocessing_data.py bug Something isn't working
#343 by bpm246 was closed May 21, 2021
2
Write Sampling Documentation documentation Improvements or additions to documentation
#252 by sdtblck was closed Aug 21, 2021
1
Integrate lm_evaluation_harness feature request New feature or request
#312 by sdtblck was closed Jun 23, 2021
3
2
Add ReLU / other activation fns feature request New feature or request
#303 by sdtblck was closed May 7, 2021
1
Implement Bf16 feature request New feature or request
#302 by sdtblck was closed Jun 22, 2021
1 task
1
Integrate distilling feature request New feature or request
#293 by StellaAthena was closed Sep 18, 2022
@StellaAthena @preethamgali
6
Abort runs if loss scale gets stuck at minimum feature request New feature or request
#291 by sdtblck was closed May 4, 2021
1
Increase Test Coverage feature request New feature or request
#286 by sweinbach was closed May 12, 2021
1
@sweinbach
Automatic tests feature request New feature or request
#278 by sweinbach was closed May 3, 2021
1
Why [seq, batch, heads, hdim] instead of [batch, seq, heads, hdim] ?
#271 by richarddwang was closed May 3, 2021
1
Enable custom val/test data feature request New feature or request
#263 by StellaAthena was closed May 9, 2021
@preethamgali
1
Resizing token embeddings to account for new special tokens feature request New feature or request
#258 by g-karthik was closed Sep 29, 2023
1
Get rid of global_vars feature request New feature or request
#254 by sdtblck was closed Apr 30, 2021
1
@sweinbach
ProTip! Updated in the last three days: updated:>2024-06-19.