Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
56 Open 373 Closed
56 Open 373 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

About gpt-neox-20B model hyperparameter
#989 by peiyingxin was closed Jul 5, 2023
1
Inquiry Regarding Documentation
#1015 by sylee96 was closed Aug 25, 2023
2
'attention.bias' and 'attention.masked_bias' not in hf_layer.state_dict() when converting gpt-neox model to huggingface bug Something isn't working
#1013 by johntzwei was closed Sep 13, 2023
1
@dashstander
2
Errors installing bug Something isn't working
#1009 by sudy-super was closed Aug 10, 2023
5
Issues installing - Bare with me please bug Something isn't working
#1006 by MistakingManx was closed Jul 28, 2023
1
Is there a way to disable data sampling? feature request New feature or request
#1005 by haozhouamzn was closed Apr 21, 2024
1
RotaryEmbedding computation is wrong for certain position/feature pairs in reduced precision (both fp16 and bfloat) bug Something isn't working
#1003 by cbcase was closed Sep 25, 2023
1
8
The class with the same name was imported twice bug Something isn't working
#999 by D-X-Y was closed Sep 25, 2023
1
The xformers result can not match with norm attention result feature request New feature or request
#998 by guozhiyao was closed Jul 20, 2023
1
how to use when --mask-before-token have values feature request New feature or request
#995 by xealml was closed Oct 4, 2023
1
@dashstander
2
A clearer explanation of data-weights with more details feature request New feature or request
#992 by leocnj was closed Jul 8, 2023
3
BF16 Trainning's bug bug Something isn't working
#991 by jiezhangGt was closed Jul 6, 2023
1
NCCL backend in DeepSpeed not yet implemented bug Something isn't working
#990 by jiezhangGt was closed Jul 5, 2023
1
How to run gpt-neox with two gtx 1080's?
#964 by therealjr was closed Jun 4, 2023
1
Training gpt stuck at the beginning feature request New feature or request
#988 by jiezhangGt was closed Jul 30, 2023
3
Distributed training with model parallelism hangs with the recent PR bug Something isn't working
#985 by absol13 was closed Jul 10, 2023
7
Any plans to implement multi-query attention feature request New feature or request
#982 by crazyofapple was closed Jun 27, 2023
1
A question about flops calculation
#981 by CSlearnerZM was closed Sep 27, 2023
1
2
Questions: does norm support sequence parallel
#980 by ftgreat was closed Jun 25, 2023
1
input decoding error on the args string of train.py bug Something isn't working
#977 by nevakrien was closed Jun 27, 2023
6
train shows an unexpected exception in best_download no explanation given bug Something isn't working
#976 by nevakrien was closed Jul 24, 2023
7
WARNING: shuffle index length is not equal to sample index length bug Something isn't working
#972 by 1ittlesnow was closed Jun 22, 2023
1
1
misindexing when converting llama weights to gpt-neox format bug Something isn't working
#971 by CRSilkworth was closed Feb 28, 2024
13
Any plans on supporting modeling_tf_gpt_neox to hugging face transformers models feature request New feature or request
#970 by praneethgb was closed Jun 7, 2023
1
Substantial decrease in FLOPs per GPU when training multinode
#965 by davidvblumenthal was closed Jul 11, 2023
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.