Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
54 Open 373 Closed
54 Open 373 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

some Datasets are not available bug Something isn't working
#1071 by vangogh0318 was closed Dec 22, 2023
2
Support for custom model architecture
#1117 by itsnamgyu was closed Feb 20, 2024
9
Support for lm_eval 0.4.0 feature request New feature or request
#1114 by ZhiYuanZeng was closed Jan 8, 2024
4
Convert HF format or raw weights of Llama2 to NEOX format feature request New feature or request
#1112 by fmh1art was closed Feb 8, 2024
1
@haileyschoelkopf
Add a Contributor Guide feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#1110 by Quentin-Anthony was closed Jan 29, 2024
1
Error in FLOPS Calculation bug Something isn't working
#1093 by passaglia was closed Dec 6, 2023
1
convert_hf_to_module（pipeline_parallel>1） feature request New feature or request
#1092 by liuxinxin123 was closed Jan 15, 2024
2
instruction finetune feature request New feature or request
#1091 by liuxinxin123 was closed Dec 5, 2023
1
Finetune feature request New feature or request
#1088 by liuxinxin123 was closed Dec 5, 2023
1
Help with: No such file or directory: '/fsx/hailey/math-lm/gpt-neox/megatron/fused_kernels'
#1083 by andrewarrow was closed Dec 19, 2023
5
ImportError: /media/h/nvme/gpt-neox/.venv/lib/python3.8/site-packages/flash_attn_2_cuda.cpython-38-x86_64-linux-gnu.so: undefined symbol: bug Something isn't working
#1079 by Drzhivago264 was closed Nov 14, 2023
1
Apply new fused rotary embedding feature request New feature or request
#1077 by Quentin-Anthony was closed Jan 5, 2024
2
@yang
10
Argument List too long error bug Something isn't working
#1076 by kavlekar101 was closed Feb 23, 2024
@jahatef
2
Abnormal number of epochs bug Something isn't working
#1018 by sudy-super was closed Nov 25, 2023
2
Recent LR Scheduler change does not account for inference/evaluation bug Something isn't working
#1059 by dashstander was closed Oct 17, 2023
1
@dashstander
Add Instructions for Loading Llama2 Models feature request New feature or request
#1051 by Quentin-Anthony was closed Feb 8, 2024
1
@Quentin-Anthony @IshanMi
5
Support Mistral Models feature request New feature or request
#1050 by Quentin-Anthony was closed Feb 26, 2024
@AIproj
8
ImportError: cannot import name 'helpers' from 'megatron.data' bug Something isn't working
#1045 by shaunstoltz was closed Sep 26, 2023
AssertionError: Not sure how to proceed, we were given deepspeed configs in the deepspeed arguments and deepspeed.initialize() function call bug Something isn't working
#1043 by shaunstoltz was closed Sep 26, 2023
Turkish Language Support feature request New feature or request
#1034 by samitugal was closed Sep 20, 2023
1
resume from checkpoint doesn't continue decaying the learning rate - it stays constant bug Something isn't working
#1029 by exnx was closed Sep 27, 2023
1
@dashstander
4
CPU Tests CI task is failing bug Something isn't working
#1025 by dashstander was closed Nov 8, 2023
1
Bug: nvcc does not exists in runtime version of nvidia base image used in Dockerfile bug Something isn't working
#1021 by changingivan was closed Jan 4, 2024
1
2
RuntimeError: Input tensor data type is not supported for NCCL process group: BFloat16 bug Something isn't working
#1020 by xu-song was closed Sep 12, 2023
can you provide pre-built images for main branch feature request New feature or request
#1019 by xu-song was closed Mar 17, 2024
1
ProTip! Exclude everything labeled bug with -label:bug.