-
Notifications
You must be signed in to change notification settings - Fork 982
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Text generation yields different outputs despite temperature = 0.0
bug
Something isn't working
good first issue
Good for newcomers
#643
opened Jul 5, 2022 by
ScTof
Finetuning loss explode when not loading deepspeed zero optimal states
bug
Something isn't working
#843
opened Mar 19, 2023 by
sxthunder
Add support for sequence parallelism
feature request
New feature or request
help wanted
This issue needs assistance
#812
opened Mar 7, 2023 by
Quentin-Anthony
Implement Prefix-LM attention masking
feature request
New feature or request
#805
opened Mar 1, 2023 by
TokyoExpress
Unable to load model checkpoint with model parallelism
feature request
New feature or request
#773
opened Jan 20, 2023 by
RaoNikitha
Fine-tuning 20B model doesn't seem to work
bug
Something isn't working
deprioritized
Issues that are not closed, but are low priority and unlikely to be solved soon
#767
opened Jan 10, 2023 by
abar-75
Multi-node training without shared memory
deprioritized
Issues that are not closed, but are low priority and unlikely to be solved soon
feature request
New feature or request
#765
opened Jan 6, 2023 by
VHellendoorn
In interactive mode prompt length more than one word causes to crash
bug
Something isn't working
deprioritized
Issues that are not closed, but are low priority and unlikely to be solved soon
#758
opened Dec 27, 2022 by
ahmedavid
loss stuck in overflow for RPE position embedding together with sparse attention
bug
Something isn't working
#292
opened May 4, 2021 by
sweinbach
RuntimeError: Error(s) in loading state_dict for EmbeddingPipe: size mismatch for word_embeddings.weight
bug
Something isn't working
good first issue
Good for newcomers
help wanted
This issue needs assistance
#645
opened Jul 7, 2022 by
mcao516
How to Load Model from pytorch_model.bin into Trained Model for Text Generation?
feature request
New feature or request
#1254
opened Jul 15, 2024 by
lieh1203
getting error saying __init__ () got an unexpected keyword argument 'checkpointable_layers' when i started training
bug
Something isn't working
#632
opened Jun 13, 2022 by
whoislimshady
OOM issues running inference with large contexts on 2x3090 system
bug
Something isn't working
#631
opened Jun 9, 2022 by
fpgaminer
Migrate tensor parallelism code to use OSLO
feature request
New feature or request
oslo
issues relating to refactoring NeoX to use OSLO
#578
opened Mar 1, 2022 by
sdtblck
3 tasks
Introduce improvements from OSLO
feature request
New feature or request
#571
opened Feb 23, 2022 by
hyunwoongko
Fine-tuning GPT-NeoX doesn't work (for many scenarios) with the 16-bit stage-0 optimizer
bug
Something isn't working
#568
opened Feb 20, 2022 by
igor0
ONNX Export / Inference Engine
feature request
New feature or request
#537
opened Feb 10, 2022 by
Mistobaan
2 tasks
Hosted Github Runners for CI
feature request
New feature or request
#531
opened Feb 9, 2022 by
Mistobaan
2 tasks
Increase Documentation Coverage
feature request
New feature or request
#458
opened Nov 7, 2021 by
sdtblck
Training speed in bf16 mode is slow.
bug
Something isn't working
#660
opened Aug 29, 2022 by
frankang
ProTip!
Updated in the last three days: updated:>2024-08-15.