-
Notifications
You must be signed in to change notification settings - Fork 981
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Implement Prefix-LM attention masking
feature request
New feature or request
#805
opened Mar 1, 2023 by
TokyoExpress
Add support for sequence parallelism
feature request
New feature or request
help wanted
This issue needs assistance
#812
opened Mar 7, 2023 by
Quentin-Anthony
Finetuning loss explode when not loading deepspeed zero optimal states
bug
Something isn't working
#843
opened Mar 19, 2023 by
sxthunder
Investigate DeepSpeed Inference
feature request
New feature or request
good first issue
Good for newcomers
#845
opened Mar 21, 2023 by
Quentin-Anthony
block-sparse flash attention support
feature request
New feature or request
good first issue
Good for newcomers
#851
opened Mar 22, 2023 by
jordiclive
Add support for pytorch 2.0 ?
deprioritized
Issues that are not closed, but are low priority and unlikely to be solved soon
feature request
New feature or request
#858
opened Mar 27, 2023 by
guozhiyao
DeepSpeed Sparse Attention is Broken
bug
Something isn't working
#863
opened Mar 29, 2023 by
dashstander
OOM error when training on a 220G Memory machine with 8 V100.
feature request
New feature or request
#867
opened Apr 2, 2023 by
SefaZeng
Previous Next
ProTip!
Follow long discussions with comments:>50.