Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
54 Open 373 Closed
54 Open 373 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cannot perform inference, be it unconditional. input-file or interactive bug Something isn't working
#1228 by srivassid was closed May 30, 2024
1
'intermediate_size' not set in tools/ckpts/convert_neox_to_hf.py for neox model architecture bug Something isn't working
#1208 by jvendrow was closed May 4, 2024
3
is there any ignore_index ability in the loss calculation? feature request New feature or request
#1193 by exnx was closed Apr 21, 2024
2
Large model instantiation using DeepSpeed.zero.Init under ZeRO-3 feature request New feature or request
#1189 by R0n12 was closed Mar 19, 2024
1
1
MoE loss variable not defined in gpt j residual code path bug Something isn't working
#1174 by tf-nv was closed Mar 8, 2024
1
بهترین تعمیرگاه موبایل در مشهد مقدس bug Something isn't working
#1173 by rezaarefi was closed Apr 19, 2024
1
pipe_parallel_size = 1 using DeepSpeed PipelineEngine bug Something isn't working
#1172 by DayOfThePenguin was closed Mar 6, 2024
1
Add Basic RWKV Block to GPT-NeoX feature request New feature or request
#1167 by Quentin-Anthony was closed Jun 19, 2024
4 tasks done
@jahatef
1
Dockerfile installation fails to run pythia 14M bug Something isn't working
#1165 by tf-nv was closed Mar 4, 2024
1
2
Is there a way to train on the entire dataset for N epochs without specifying train-iters?
#1164 by javirandor was closed Mar 18, 2024
@AIproj
4
Converting Pythia checkpoint from HF to NeoX fails bug Something isn't working
#1161 by malteos was closed Mar 4, 2024
1
@haileyschoelkopf
3
continue training from a checkpoint with different number of gpu/node
#1158 by mackmake was closed Mar 15, 2024
1
Add PyTorch Memory Profiler feature request New feature or request
#1152 by Quentin-Anthony was closed Feb 21, 2024
1
@jahatef
How to convert gpt-neox to llama architecture..?
#1151 by yuri-son was closed Apr 21, 2024
1
Add basic Mamba block feature request New feature or request
#1148 by Quentin-Anthony was closed Mar 10, 2024
3 of 4 tasks
1
NCCL error in: ProcessGroupNCCL.cpp:1269, internal error, NCCL version 2.14.3
#1147 by mackmake was closed Apr 21, 2024
4
files in multi-node training
#1146 by mackmake was closed Feb 26, 2024
2
Update to current versions of python and pytorch feature request New feature or request
#1143 by segyges was closed Feb 23, 2024
1
@segyges
Error on inference of huggingface
#1142 by mackmake was closed Feb 4, 2024
2
calculate epoch
#1140 by mackmake was closed Feb 3, 2024
4
Port NVIDIA Nsight profiling to gpt-neox feature request New feature or request
#1134 by Quentin-Anthony was closed Feb 23, 2024
1 of 2 tasks
1
FileNotFoundError thrown when training bug Something isn't working
#1127 by obicons was closed Apr 21, 2024
5
[BUG] Setting Finetune=True causes checkpoint loading to not work correctly bug Something isn't working
#1121 by exnx was closed Mar 1, 2024
@Quentin-Anthony
5
Support for custom model architecture
#1117 by itsnamgyu was closed Feb 20, 2024
9
Support for lm_eval 0.4.0 feature request New feature or request
#1114 by ZhiYuanZeng was closed Jan 8, 2024
4
ProTip! Add no:assignee to see everything that’s not assigned.