Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort

Issues list

Migrate tensor parallelism code to use OSLO feature request New feature or request oslo issues relating to refactoring NeoX to use OSLO
#578 opened Mar 1, 2022 by sdtblck
3 tasks
Add Mixture of Experts feature request New feature or request
#479 by sdtblck was closed Mar 7, 2024
3
Add NeoXArgs Documentation Generation to CI feature request New feature or request
#462 by sdtblck was closed Mar 22, 2022
Add black code formatting to CI feature request New feature or request
#461 by sdtblck was closed Feb 12, 2022
Fix checkpoint / config file management feature request New feature or request
#459 by sdtblck was closed Nov 26, 2021
Increase Documentation Coverage feature request New feature or request
#458 opened Nov 7, 2021 by sdtblck
Add 8 bit optimizers feature request New feature or request
#439 by sdtblck was closed Oct 31, 2021
Index Errors with Weighted Dataset bug Something isn't working
#377 by sdtblck was closed Jul 30, 2021
Add shampoo optimizer feature request New feature or request
#314 opened May 10, 2021 by sdtblck
Integrate lm_evaluation_harness feature request New feature or request
#312 by sdtblck was closed Jun 23, 2021
3
2
Add ReLU / other activation fns feature request New feature or request
#303 by sdtblck was closed May 7, 2021
Implement Bf16 feature request New feature or request
#302 by sdtblck was closed Jun 22, 2021
1 task
Abort runs if loss scale gets stuck at minimum feature request New feature or request
#291 by sdtblck was closed May 4, 2021
Get rid of global_vars feature request New feature or request
#254 by sdtblck was closed Apr 30, 2021
Write Sampling Documentation documentation Improvements or additions to documentation
#252 by sdtblck was closed Aug 21, 2021
Get rid of codepath where pp = 0 feature request New feature or request
#243 by sdtblck was closed Apr 30, 2021
Timer logging innacurate if pp=0 bug Something isn't working
#238 by sdtblck was closed Apr 30, 2021
Bias Gelu Fusion + GEGLU errors bug Something isn't working
#237 by sdtblck was closed May 7, 2021
Fix Fused Kernel compiler getting stuck bug Something isn't working
#232 by sdtblck was closed Jun 23, 2021
Local wandb logging is borked bug Something isn't working
#229 by sdtblck was closed Jun 20, 2021
Add Unit Tests / Style Tests documentation Improvements or additions to documentation feature request New feature or request good first issue Good for newcomers
#221 by sdtblck was closed Apr 28, 2021
4 tasks
Error upon finishing a run bug Something isn't working
#216 by sdtblck was closed Apr 25, 2021
Add Progressive Growing of Batch Size feature request New feature or request
#215 by sdtblck was closed Sep 29, 2023
Add Madgrad feature request New feature or request
#210 by sdtblck was closed May 3, 2021
Add Adafactor feature request New feature or request
#209 by sdtblck was closed Mar 1, 2022
ProTip! Exclude everything labeled bug with -label:bug.