Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
54 Open 373 Closed
54 Open 373 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Integrate DeepSpeed feature request New feature or request
#4 by StellaAthena was closed Dec 26, 2020
2
Build a Tensorboard feature request New feature or request
#5 by StellaAthena was closed Dec 27, 2020
1
Allow for alternative architectures feature request New feature or request
#6 by StellaAthena was closed Jan 4, 2021
Hardcoded paths in gpt3_small.json bug Something isn't working
#26 by anthony-dipofi was closed Jan 5, 2021
1
Dataset downloads <number of GPUs> times when running deepspeed train.py
#37 by sdtblck was closed Jan 5, 2021
1
Openwebtext2 dataset checks for presence of tar.gz file to assess whether to auto-download rather than extracted dataset
#38 by sdtblck was closed Jan 5, 2021
1
Fix tfrecord dataset to load less files into memory bug Something isn't working
#41 by sdtblck was closed Mar 2, 2021
1
@trisongz @anthony-dipofi
How to calculate parameters
#100 by Carolingliang was closed Jan 28, 2021
Version conflict on colab bug Something isn't working
#116 by ShivanshuPurohit was closed Feb 17, 2021
Figure out what’s taking so long to do comms bug Something isn't working experiments Experiments we wish to perform on the codebase help wanted This issue needs assistance
#126 by StellaAthena was closed Aug 28, 2021
@sdtblck
Figure out why 1-bit Adam pretends to run bug Something isn't working documentation Improvements or additions to documentation experiments Experiments we wish to perform on the codebase
#128 by StellaAthena was closed Mar 4, 2021
1
Fix our configs experiments Experiments we wish to perform on the codebase
#133 by StellaAthena was closed Feb 27, 2021
1
@joshlk
Change corpora to use lm-dataformat feature request New feature or request good first issue Good for newcomers
#165 by leogao2 was closed Apr 11, 2021
Why doesn't 1-bit adam improve pipeline parallel speed? bug Something isn't working
#206 by sdtblck was closed Dec 30, 2021
Check if ZeRO-3 is actually slower bug Something isn't working
#211 by StellaAthena was closed Apr 6, 2021
@StellaAthena
Error upon finishing a run bug Something isn't working
#216 by sdtblck was closed Apr 25, 2021
1
Local wandb logging is borked bug Something isn't working
#229 by sdtblck was closed Jun 20, 2021
1
Bias Gelu Fusion + GEGLU errors bug Something isn't working
#237 by sdtblck was closed May 7, 2021
1
Timer logging innacurate if pp=0 bug Something isn't working
#238 by sdtblck was closed Apr 30, 2021
1
Get rid of codepath where pp = 0 feature request New feature or request
#243 by sdtblck was closed Apr 30, 2021
1
Refacturing Config feature request New feature or request
#245 by sweinbach was closed Apr 26, 2021
1
@sweinbach @sdtblck
Write Sampling Documentation documentation Improvements or additions to documentation
#252 by sdtblck was closed Aug 21, 2021
1
Get rid of global_vars feature request New feature or request
#254 by sdtblck was closed Apr 30, 2021
1
@sweinbach
Increase Test Coverage feature request New feature or request
#286 by sweinbach was closed May 12, 2021
1
@sweinbach
Implement Bf16 feature request New feature or request
#302 by sdtblck was closed Jun 22, 2021
1 task
1
ProTip! Mix and match filters to narrow down what you’re looking for.