Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
3 Open 105 Closed
3 Open 105 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

1.0 HF conversion script fails on Python 3.8 bug Something isn't working
#875 by syskn was closed May 18, 2023
1
@haileyschoelkopf
7
AliBi + Flash Attention Support feature request New feature or request
#848 by Quentin-Anthony was closed Apr 11, 2023
1
@dashstander @Quentin-Anthony
1
Unable to run generate text bug Something isn't working
#885 by hax4usincupad was closed Apr 21, 2023
1
6
how to use when --mask-before-token have values feature request New feature or request
#995 by xealml was closed Oct 4, 2023
1
@dashstander
2
Running with bf16 error bug Something isn't working good first issue Good for newcomers
#939 by Life-0-1 was closed May 18, 2023
1
@dashstander
9
Incorporation of LION Optimizer in GPT-NeoX feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#950 by withwsf was closed Oct 20, 2023
1
Configs are not broadcasted properly in multi-node training bug Something isn't working
#925 by silverriver was closed May 23, 2023
1
@dashstander @StellaAthena
11
The class with the same name was imported twice bug Something isn't working
#999 by D-X-Y was closed Sep 25, 2023
1
resume from checkpoint doesn't continue decaying the learning rate - it stays constant bug Something isn't working
#1029 by exnx was closed Sep 27, 2023
1
@dashstander
4
Recent LR Scheduler change does not account for inference/evaluation bug Something isn't working
#1059 by dashstander was closed Oct 17, 2023
1
@dashstander
RotaryEmbedding computation is wrong for certain position/feature pairs in reduced precision (both fp16 and bfloat) bug Something isn't working
#1003 by cbcase was closed Sep 25, 2023
1
8
Implement Bf16 feature request New feature or request
#302 by sdtblck was closed Jun 22, 2021
1 task
1
CPU Tests CI task is failing bug Something isn't working
#1025 by dashstander was closed Nov 8, 2023
1
Robust testing suite feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#957 by StellaAthena was closed Dec 4, 2023
25 tasks
1
@mkerin
8
Error in FLOPS Calculation bug Something isn't working
#1093 by passaglia was closed Dec 6, 2023
1
Bug: nvcc does not exists in runtime version of nvidia base image used in Dockerfile bug Something isn't working
#1021 by changingivan was closed Jan 4, 2024
1
2
Apply new fused rotary embedding feature request New feature or request
#1077 by Quentin-Anthony was closed Jan 5, 2024
2
@yang
10
Add PyTorch Memory Profiler feature request New feature or request
#1152 by Quentin-Anthony was closed Feb 21, 2024
1
@jahatef
Add Instructions for Loading Llama2 Models feature request New feature or request
#1051 by Quentin-Anthony was closed Feb 8, 2024
1
@Quentin-Anthony @IshanMi
5
Convert HF format or raw weights of Llama2 to NEOX format feature request New feature or request
#1112 by fmh1art was closed Feb 8, 2024
1
@haileyschoelkopf
Port NVIDIA Nsight profiling to gpt-neox feature request New feature or request
#1134 by Quentin-Anthony was closed Feb 23, 2024
1 of 2 tasks
1
Update to current versions of python and pytorch feature request New feature or request
#1143 by segyges was closed Feb 23, 2024
1
@segyges
Add a Contributor Guide feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#1110 by Quentin-Anthony was closed Jan 29, 2024
1
Converting Pythia checkpoint from HF to NeoX fails bug Something isn't working
#1161 by malteos was closed Mar 4, 2024
1
@haileyschoelkopf
3
Add Mixture of Experts feature request New feature or request
#479 by sdtblck was closed Mar 7, 2024
3
@Quentin-Anthony
ProTip! Mix and match filters to narrow down what you’re looking for.