-
Notifications
You must be signed in to change notification settings - Fork 982
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Fix output_layer_parallelism = "row"
bug
Something isn't working
help wanted
This issue needs assistance
#916
by Quentin-Anthony
was closed May 19, 2023
[question] How were the default values of
checkpoint-factor
selected?
#914
by obicons
was closed May 1, 2023
Do pythia untied embedding and unembedding matrics?
bug
Something isn't working
#913
by Life-0-1
was closed May 1, 2023
Add arguments for turning off fused kernels to work with native pytorch
feature request
New feature or request
#906
by mayank31398
was closed May 11, 2023
Default of Something isn't working
output_layer_parallelism = "row"
is broken for model-parallel training
bug
#905
by cbcase
was closed May 12, 2023
when preprocess data and load data using "lazy" mode
bug
Something isn't working
#904
by peiyingxin
was closed Sep 18, 2023
cant preprocess_data using custom tokinzer.
bug
Something isn't working
#898
by snirbenyosef
was closed Apr 22, 2023
Can I pretrain a 65B or 175B model use this code?
feature request
New feature or request
#890
by lc222
was closed Apr 20, 2023
Unable to run generate text
bug
Something isn't working
#885
by hax4usincupad
was closed Apr 21, 2023
tuple index out of range in _exec_send_grads p2p.send
bug
Something isn't working
#884
by drcege
was closed Apr 22, 2023
Some problems when using generate.py and how to fix it
bug
Something isn't working
#883
by DaoD
was closed Apr 21, 2023
How to convert a model parallel model to hugging face model?
feature request
New feature or request
#880
by guozhiyao
was closed May 18, 2023
How to convert a model parallel model to hugging face model?
feature request
New feature or request
#879
by guozhiyao
was closed Apr 13, 2023
Got an empty gpt2-tokenizer while pretraining with THE-PILE dataset
bug
Something isn't working
#876
by LostSpirit1307
was closed May 11, 2023
1.0 HF conversion script fails on Python 3.8
bug
Something isn't working
#875
by syskn
was closed May 18, 2023
Wrong rotary embedding result between transformers structure and Megatron structure
bug
Something isn't working
#873
by GGGGGGXY
was closed Apr 18, 2023
RuntimeError: probability tensor contains either inf, nan or element < 0
bug
Something isn't working
#871
by believeland23
was closed Apr 22, 2023
RuntimeError: The expanded size of the tensor (1) must match the existing size (10) at non-singleton dimension 2
bug
Something isn't working
#870
by crazyofapple
was closed Apr 13, 2023
read in/have a additional column in the training data
feature request
New feature or request
#865
by davidvblumenthal
was closed Apr 5, 2023
Adding data to continue training failed.
feature request
New feature or request
#860
by SefaZeng
was closed May 18, 2023
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.