Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
55 Open 373 Closed
55 Open 373 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How to preprocess data from plaintext
#935 by Maniues was closed May 14, 2023
2
bf16 is incompatible with pipe parallelism bug Something isn't working
#963 by Life-0-1 was closed Sep 18, 2023
1
@dashstander
8
Officially Support AMD GPUs feature request New feature or request
#954 by Quentin-Anthony was closed Apr 21, 2024
4 tasks done
1
@R0n12
5
Better Document Distributed Jobs feature request New feature or request good first issue Good for newcomers
#953 by Quentin-Anthony was closed Sep 29, 2023
1 task
1
@dashstander
2
Support Megatron LayerNorm kernel feature request New feature or request good first issue Good for newcomers
#952 by Quentin-Anthony was closed Jan 26, 2024
2 tasks
3
Incorporation of LION Optimizer in GPT-NeoX feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#950 by withwsf was closed Oct 20, 2023
1
Preconfigured Datasets are not available bug Something isn't working
#949 by vogt31337 was closed May 24, 2023
3
When llama uses bf16 training, there is an abnormal loss bug Something isn't working
#947 by suolyer was closed Apr 21, 2024
1
[Question] about clearly params feature request New feature or request
#945 by phamkhactu was closed May 24, 2023
4
[Question] about summarization tasks question
#943 by phamkhactu was closed May 19, 2023
3
change max-position-embeddings after pretrain. feature request New feature or request
#942 by guozhiyao was closed Jun 3, 2023
1
[Training followed tutorial] error: exits with return code = -7 bug Something isn't working
#940 by phamkhactu was closed May 18, 2023
6
Running with bf16 error bug Something isn't working good first issue Good for newcomers
#939 by Life-0-1 was closed May 18, 2023
1
@dashstander
9
Fix output_layer_parallelism = "row" bug Something isn't working help wanted This issue needs assistance
#916 by Quentin-Anthony was closed May 19, 2023
1
Import megatron.data.helpers failing bug Something isn't working
#934 by convexstrictly was closed May 12, 2023
5
Dockerfile error bug Something isn't working
#933 by KonradWygladacz was closed Aug 22, 2023
10
FIM implementation question feature request New feature or request
#932 by liddalidd was closed May 22, 2023
@haileyschoelkopf
3
Is Support FIM mode? feature request New feature or request
#930 by zxyscz was closed May 11, 2023
1
RuntimeError: stack expects each tensor to be equal size bug Something isn't working
#929 by cateto was closed Jun 5, 2023
4
Configs are not broadcasted properly in multi-node training bug Something isn't working
#925 by silverriver was closed May 23, 2023
1
@dashstander @StellaAthena
11
Pre-trained Model with Sparse/BlockSparse Attention for Long Sequences and Reduced GPU Memory Consumption feature request New feature or request
#924 by puyuanOT was closed May 5, 2023
1
Why GPT2Dataset shuffles documents? feature request New feature or request
#923 by kosstbarz was closed May 5, 2023
1
Reconstructing the FP32 weights | HuggingFace conversion feature request New feature or request
#922 by davidvblumenthal was closed May 8, 2023
3
Make Configs Consistent bug Something isn't working good first issue Good for newcomers
#920 by StellaAthena was closed May 9, 2023
@austinburnett
8
when training with multi node, raise filenotfound error bug Something isn't working
#919 by cateto was closed May 9, 2023
2
ProTip! Updated in the last three days: updated:>2024-06-26.