Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
6 Open 21 Closed
6 Open 21 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

LoRA Support feature request New feature or request
#1204 opened Apr 23, 2024 by Quentin-Anthony
4 tasks
@mkerin
1
Add Basic RWKV Block to GPT-NeoX feature request New feature or request
#1167 by Quentin-Anthony was closed Jun 19, 2024
4 tasks done
@jahatef
1
Add PyTorch Memory Profiler feature request New feature or request
#1152 by Quentin-Anthony was closed Feb 21, 2024
1
@jahatef
Add basic Mamba block feature request New feature or request
#1148 by Quentin-Anthony was closed Mar 10, 2024
3 of 4 tasks
1
Port NVIDIA Nsight profiling to gpt-neox feature request New feature or request
#1134 by Quentin-Anthony was closed Feb 23, 2024
1 of 2 tasks
1
Create Singularity Container feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#1119 opened Jan 11, 2024 by Quentin-Anthony
@jahatef
1
Add a Contributor Guide feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#1110 by Quentin-Anthony was closed Jan 29, 2024
1
Integrate TransformerEngine feature request New feature or request
#1098 opened Dec 21, 2023 by Quentin-Anthony
6
Port DeepSpeed Ulysses feature request New feature or request
#1078 opened Nov 12, 2023 by Quentin-Anthony
1
@Quentin-Anthony
1
Apply new fused rotary embedding feature request New feature or request
#1077 by Quentin-Anthony was closed Jan 5, 2024
2
@yang
10
Add Instructions for Loading Llama2 Models feature request New feature or request
#1051 by Quentin-Anthony was closed Feb 8, 2024
1
@Quentin-Anthony @IshanMi
5
Support Mistral Models feature request New feature or request
#1050 by Quentin-Anthony was closed Feb 26, 2024
@AIproj
8
Officially Support AMD GPUs feature request New feature or request
#954 by Quentin-Anthony was closed Apr 21, 2024
4 tasks done
1
@R0n12
5
Better Document Distributed Jobs feature request New feature or request good first issue Good for newcomers
#953 by Quentin-Anthony was closed Sep 29, 2023
1 task
1
@dashstander
2
Support Megatron LayerNorm kernel feature request New feature or request good first issue Good for newcomers
#952 by Quentin-Anthony was closed Jan 26, 2024
2 tasks
3
Fix output_layer_parallelism = "row" bug Something isn't working help wanted This issue needs assistance
#916 by Quentin-Anthony was closed May 19, 2023
1
Organize the tools feature request New feature or request help wanted This issue needs assistance
#856 by Quentin-Anthony was closed Oct 2, 2023
1
@StellaAthena
1
Single-node MPI/Slurm launching is broken bug Something isn't working
#849 by Quentin-Anthony was closed Apr 3, 2023
1
@curt-tigges
AliBi + Flash Attention Support feature request New feature or request
#848 by Quentin-Anthony was closed Apr 11, 2023
1
@dashstander @Quentin-Anthony
1
Create script to allow conversion from HF ckpt to neox feature request New feature or request
#846 by Quentin-Anthony was closed Jun 2, 2023
3 tasks
@bentherien
5
Investigate DeepSpeed Inference feature request New feature or request good first issue Good for newcomers
#845 opened Mar 21, 2023 by Quentin-Anthony
@IshanMi @haileyschoelkopf
7
Support fp16 scale tolerance feature request New feature or request help wanted This issue needs assistance
#829 by Quentin-Anthony was closed May 18, 2023
6
Add support for sequence parallelism feature request New feature or request help wanted This issue needs assistance
#812 opened Mar 7, 2023 by Quentin-Anthony
1
@Quentin-Anthony
12
Allow users to pass extra DeepSpeed arguments through config feature request New feature or request
#791 by Quentin-Anthony was closed Mar 26, 2023
1
@curt-tigges
Make prepare_data.py more robust feature request New feature or request
#788 by Quentin-Anthony was closed Mar 26, 2023
@curt-tigges
3
ProTip! What’s not been updated in a month: updated:<2024-06-21.