Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
58 Open 375 Closed
58 Open 375 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Fix output_layer_parallelism = "row" bug Something isn't working help wanted This issue needs assistance
#916 by Quentin-Anthony was closed May 19, 2023
1
[question] How were the default values of checkpoint-factor selected?
#914 by obicons was closed May 1, 2023
2
Do pythia untied embedding and unembedding matrics? bug Something isn't working
#913 by Life-0-1 was closed May 1, 2023
5
None of the urls in corpora.py are live question
#909 by VivekBits2210 was closed May 2, 2023
1
Add arguments for turning off fused kernels to work with native pytorch feature request New feature or request
#906 by mayank31398 was closed May 11, 2023
@mayank31398
2
Default of output_layer_parallelism = "row" is broken for model-parallel training bug Something isn't working
#905 by cbcase was closed May 12, 2023
4
when preprocess data and load data using "lazy" mode bug Something isn't working
#904 by peiyingxin was closed Sep 18, 2023
1
@dashstander @StellaAthena
6
pipeline parallelism lead to slower speeds
#903 by cdj0311 was closed May 8, 2023
14
cant preprocess_data using custom tokinzer. bug Something isn't working
#898 by snirbenyosef was closed Apr 22, 2023
1
Training on SLURM Cluster without deepspeed launcher
#891 by RobinQrtz was closed Apr 25, 2023
2
Can I pretrain a 65B or 175B model use this code? feature request New feature or request
#890 by lc222 was closed Apr 20, 2023
1
Unable to run generate text bug Something isn't working
#885 by hax4usincupad was closed Apr 21, 2023
1
6
tuple index out of range in _exec_send_grads p2p.send bug Something isn't working
#884 by drcege was closed Apr 22, 2023
7
Some problems when using generate.py and how to fix it bug Something isn't working
#883 by DaoD was closed Apr 21, 2023
@dashstander
2
How to convert a model parallel model to hugging face model? feature request New feature or request
#880 by guozhiyao was closed May 18, 2023
@haileyschoelkopf
7
How to convert a model parallel model to hugging face model? feature request New feature or request
#879 by guozhiyao was closed Apr 13, 2023
1
Got an empty gpt2-tokenizer while pretraining with THE-PILE dataset bug Something isn't working
#876 by LostSpirit1307 was closed May 11, 2023
4
1.0 HF conversion script fails on Python 3.8 bug Something isn't working
#875 by syskn was closed May 18, 2023
1
@haileyschoelkopf
7
Wrong rotary embedding result between transformers structure and Megatron structure bug Something isn't working
#873 by GGGGGGXY was closed Apr 18, 2023
@zphang @StellaAthena
2
Does it work without Nvidia GPU?
#872 by Maniues was closed Apr 14, 2023
5
RuntimeError: probability tensor contains either inf, nan or element < 0 bug Something isn't working
#871 by believeland23 was closed Apr 22, 2023
1
RuntimeError: The expanded size of the tensor (1) must match the existing size (10) at non-singleton dimension 2 bug Something isn't working
#870 by crazyofapple was closed Apr 13, 2023
4
read in/have a additional column in the training data feature request New feature or request
#865 by davidvblumenthal was closed Apr 5, 2023
6
fine-tune model for commercial use?
#861 by lw3259111 was closed Apr 3, 2023
2
Adding data to continue training failed. feature request New feature or request
#860 by SefaZeng was closed May 18, 2023
11
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.