Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
3 Open 37 Closed
3 Open 37 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add Unit Tests / Style Tests documentation Improvements or additions to documentation feature request New feature or request good first issue Good for newcomers
#221 by sdtblck was closed Apr 28, 2021
4 tasks
1
2
Add Deepspeed Transformer Kernel feature request New feature or request good first issue Good for newcomers
#43 by sdtblck was closed Jan 10, 2021
4
Implement Pipeline Parallelism feature request New feature or request
#45 by sdtblck was closed Jan 14, 2021
1
@StellaAthena @anthony-dipofi
6
Ensure learning rate scheduler is functioning correctly bug Something isn't working documentation Improvements or additions to documentation
#44 by sdtblck was closed Jan 23, 2021
1
Implement Generation / Eval with deepspeed model engine feature request New feature or request
#58 by sdtblck was closed Feb 15, 2021
6
Write dataset class that tokenizes on the fly feature request New feature or request
#40 by sdtblck was closed Feb 15, 2021
1
1
Fix tfrecord dataset to load less files into memory bug Something isn't working
#41 by sdtblck was closed Mar 2, 2021
1
@trisongz @anthony-dipofi
Ensure Checkpoint Saving / Loading works correctly bug Something isn't working
#151 by sdtblck was closed Mar 6, 2021
4
Number of GPUs not automatically detected on a single node instance
#194 by sdtblck was closed Apr 5, 2021
1
Integrate HuggingFace Tokenizers feature request New feature or request good first issue Good for newcomers
#190 by sdtblck was closed Apr 7, 2021
@sdtblck
2
Can we get sparse attention working with A100s / CUDA 11? feature request New feature or request
#207 by sdtblck was closed Apr 9, 2021
2
Ensure Sampling works correctly experiments Experiments we wish to perform on the codebase feature request New feature or request
#152 by sdtblck was closed Apr 22, 2021
1
@joshlk
2
Dataset downloads <number of GPUs> times when running deepspeed train.py
#37 by sdtblck was closed Jan 5, 2021
1
Error upon finishing a run bug Something isn't working
#216 by sdtblck was closed Apr 25, 2021
1
Timer logging innacurate if pp=0 bug Something isn't working
#238 by sdtblck was closed Apr 30, 2021
1
Get rid of codepath where pp = 0 feature request New feature or request
#243 by sdtblck was closed Apr 30, 2021
1
Code Cleanup documentation Improvements or additions to documentation
#208 by sdtblck was closed Apr 30, 2021
3 tasks done
1
Get rid of global_vars feature request New feature or request
#254 by sdtblck was closed Apr 30, 2021
1
@sweinbach
Add Madgrad feature request New feature or request
#210 by sdtblck was closed May 3, 2021
1
@preethamgali
1
Abort runs if loss scale gets stuck at minimum feature request New feature or request
#291 by sdtblck was closed May 4, 2021
1
Bias Gelu Fusion + GEGLU errors bug Something isn't working
#237 by sdtblck was closed May 7, 2021
1
Add ReLU / other activation fns feature request New feature or request
#303 by sdtblck was closed May 7, 2021
1
Local wandb logging is borked bug Something isn't working
#229 by sdtblck was closed Jun 20, 2021
1
Fix Fused Kernel compiler getting stuck bug Something isn't working
#232 by sdtblck was closed Jun 23, 2021
1
Add Mixture of Experts feature request New feature or request
#479 by sdtblck was closed Mar 7, 2024
3
@Quentin-Anthony
ProTip! Find all open issues with in progress development work with linked:pr.