-
Notifications
You must be signed in to change notification settings - Fork 977
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Build a Tensorboard
feature request
New feature or request
#5
by StellaAthena
was closed Dec 27, 2020
Integrate DeepSpeed
feature request
New feature or request
#4
by StellaAthena
was closed Dec 26, 2020
2
Implement 1-Bit Adam
feature request
New feature or request
good first issue
Good for newcomers
#69
by StellaAthena
was closed Jan 23, 2021
(T5) Relative positional encodings?
feature request
New feature or request
#66
by CRG2K
was closed Mar 4, 2021
Implement the MPU from Megatron
feature request
New feature or request
#75
by StellaAthena
was closed Feb 15, 2021
AttributeError: module 'torch.utils' has no attribute 'checkpoint' in gpt-neox/gpt-neox
bug
Something isn't working
#80
by kinoc
was closed Jan 23, 2021
Implement Pipeline Parallelism
feature request
New feature or request
#45
by sdtblck
was closed Jan 14, 2021
Write dataset class that tokenizes on the fly
feature request
New feature or request
#40
by sdtblck
was closed Feb 15, 2021
ftfy used in create_tfrecords.py but not listed in requirements.txt
bug
Something isn't working
#28
by anthony-dipofi
was closed Jan 4, 2021
Dataset downloads <number of GPUs> times when running deepspeed train.py
#37
by sdtblck
was closed Jan 5, 2021
Pipeline parallelism and gradient checkpointing (edit: and ZeRO 2!) don’t work together
bug
Something isn't working
#62
by StellaAthena
was closed Jan 28, 2021
Expand to all 8 CoreWeave Machines
feature request
New feature or request
#68
by StellaAthena
was closed Jan 24, 2021
Figure out why 1-bit Adam pretends to run
bug
Something isn't working
documentation
Improvements or additions to documentation
experiments
Experiments we wish to perform on the codebase
#128
by StellaAthena
was closed Mar 4, 2021
Take ZeRO 3 for a test drive
experiments
Experiments we wish to perform on the codebase
feature request
New feature or request
#171
by StellaAthena
was closed Dec 4, 2021
Ensure Sampling works correctly
experiments
Experiments we wish to perform on the codebase
feature request
New feature or request
#152
by sdtblck
was closed Apr 22, 2021
Write Sampling Documentation
documentation
Improvements or additions to documentation
#252
by sdtblck
was closed Aug 21, 2021
Get rid of global_vars
feature request
New feature or request
#254
by sdtblck
was closed Apr 30, 2021
Add ReLU / other activation fns
feature request
New feature or request
#303
by sdtblck
was closed May 7, 2021
Integrate lm_evaluation_harness
feature request
New feature or request
#312
by sdtblck
was closed Jun 23, 2021
Index Errors with Weighted Dataset
bug
Something isn't working
#377
by sdtblck
was closed Jul 30, 2021
Previous Next
ProTip!
Exclude everything labeled
bug
with -label:bug.