Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
43 Open 286 Closed
43 Open 286 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Fix output_layer_parallelism = "row" bug Something isn't working help wanted This issue needs assistance
#916 by Quentin-Anthony was closed May 19, 2023
1
[question] How were the default values of checkpoint-factor selected?
#914 by obicons was closed May 1, 2023
2
Do pythia untied embedding and unembedding matrics? bug Something isn't working
#913 by Life-0-1 was closed May 1, 2023
5
None of the urls in corpora.py are live question
#909 by VivekBits2210 was closed May 2, 2023
1
Default of output_layer_parallelism = "row" is broken for model-parallel training bug Something isn't working
#905 by cbcase was closed May 12, 2023
4
pipeline parallelism lead to slower speeds
#903 by cdj0311 was closed May 8, 2023
14
cant preprocess_data using custom tokinzer. bug Something isn't working
#898 by snirbenyosef was closed Apr 22, 2023
1
Training on SLURM Cluster without deepspeed launcher
#891 by RobinQrtz was closed Apr 25, 2023
2
Can I pretrain a 65B or 175B model use this code? feature request New feature or request
#890 by lc222 was closed Apr 20, 2023
1
Unable to run generate text bug Something isn't working
#885 by hax4usincupad was closed Apr 21, 2023
1
6
tuple index out of range in _exec_send_grads p2p.send bug Something isn't working
#884 by drcege was closed Apr 22, 2023
7
How to convert a model parallel model to hugging face model? feature request New feature or request
#879 by guozhiyao was closed Apr 13, 2023
1
Got an empty gpt2-tokenizer while pretraining with THE-PILE dataset bug Something isn't working
#876 by LostSpirit1307 was closed May 11, 2023
4
Does it work without Nvidia GPU?
#872 by Maniues was closed Apr 14, 2023
5
RuntimeError: probability tensor contains either inf, nan or element < 0 bug Something isn't working
#871 by believeland23 was closed Apr 22, 2023
1
RuntimeError: The expanded size of the tensor (1) must match the existing size (10) at non-singleton dimension 2 bug Something isn't working
#870 by crazyofapple was closed Apr 13, 2023
4
read in/have a additional column in the training data feature request New feature or request
#865 by davidvblumenthal was closed Apr 5, 2023
6
fine-tune model for commercial use?
#861 by lw3259111 was closed Apr 3, 2023
2
Adding data to continue training failed. feature request New feature or request
#860 by SefaZeng was closed May 18, 2023
11
cannot import name '_ALL_VERSIONS' from 'regex._regex_core' bug Something isn't working
#852 by DaoD was closed Mar 23, 2023
Does the model support the task in Chinese? feature request New feature or request
#844 by wsh2836741 was closed Mar 20, 2023
3
Competator - GPT4 feature request New feature or request
#840 by Tortoise17 was closed Mar 17, 2023
Instruction tuned version of GPT-Neo-X feature request New feature or request
#838 by djaym7 was closed Mar 16, 2023
1
Support fp16 scale tolerance feature request New feature or request help wanted This issue needs assistance
#829 by Quentin-Anthony was closed May 18, 2023
6
how much GPU memory at least ? feature request New feature or request
#827 by XuJianzhi was closed Mar 13, 2023
ProTip! Find all open issues with in progress development work with linked:pr.