Skip to content

Issues: EleutherAI/gpt-neox

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
58 Open 375 Closed
58 Open 375 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add shampoo optimizer feature request New feature or request
#314 opened May 10, 2021 by sdtblck
1
ONNX Export / Inference Engine feature request New feature or request
#537 opened Feb 10, 2022 by Mistobaan
2 tasks
OOM issues running inference with large contexts on 2x3090 system bug Something isn't working
#631 opened Jun 9, 2022 by fpgaminer
Text generation yields different outputs despite temperature = 0.0 bug Something isn't working good first issue Good for newcomers
#643 opened Jul 5, 2022 by ScTof
Package Megatron feature request New feature or request
#708 opened Oct 26, 2022 by cat-state
Multi-node training without shared memory deprioritized Issues that are not closed, but are low priority and unlikely to be solved soon feature request New feature or request
#765 opened Jan 6, 2023 by VHellendoorn
Why we need to average LayerNorm values over mp ranks when converting to HFformat checkpoint?
#983 opened Jun 26, 2023 by forceshorty
PyTorch Lightning Fused optimizer step feature request New feature or request
#1160 opened Feb 29, 2024 by jahatef
batch_input and elapsed time per iteration suddenly slow down during model training bug Something isn't working
#1248 opened Jun 29, 2024 by Yuhanleeee
what's the biggest dataset you've tried? bug Something isn't working
#1253 opened Jul 15, 2024 by exnx
How to Load Model from pytorch_model.bin into Trained Model for Text Generation? feature request New feature or request
#1254 opened Jul 15, 2024 by lieh1203
loss stuck in overflow for RPE position embedding together with sparse attention bug Something isn't working
#292 opened May 4, 2021 by sweinbach
1
Increase Documentation Coverage feature request New feature or request
#458 opened Nov 7, 2021 by sdtblck
1
Fine-tuning GPT-NeoX doesn't work (for many scenarios) with the 16-bit stage-0 optimizer bug Something isn't working
#568 opened Feb 20, 2022 by igor0
1
getting error saying __init__ () got an unexpected keyword argument 'checkpointable_layers' when i started training bug Something isn't working
#632 opened Jun 13, 2022 by whoislimshady
1
Interactive inference fails bug Something isn't working
#699 opened Oct 1, 2022 by tonsOfStu
1
Implement Prefix-LM attention masking feature request New feature or request
#805 opened Mar 1, 2023 by TokyoExpress
1
Add support for pytorch 2.0 ? deprioritized Issues that are not closed, but are low priority and unlikely to be solved soon feature request New feature or request
#858 opened Mar 27, 2023 by guozhiyao
1
Bias weights are multi-added when using gpt_j_residual in model-parallel execution bug Something isn't working good first issue Good for newcomers
#962 opened May 31, 2023 by cbcase
1
Convert HF Llama Checkpoints to Neox Checkpoints feature request New feature or request
#994 opened Jul 10, 2023 by sxthunder
1
Support for Mosaic Models feature request New feature or request
#1057 opened Oct 6, 2023 by rajveer43
1
Port DeepSpeed Ulysses feature request New feature or request
#1078 opened Nov 12, 2023 by Quentin-Anthony
1
@Quentin-Anthony
1
Create Singularity Container feature request New feature or request good first issue Good for newcomers help wanted This issue needs assistance
#1119 opened Jan 11, 2024 by Quentin-Anthony
@jahatef
1
Tests fail when run with pytest --forked bug Something isn't working
#1132 opened Jan 25, 2024 by segyges
1
LoRA Support feature request New feature or request
#1204 opened Apr 23, 2024 by Quentin-Anthony
4 tasks
@mkerin
1
ProTip! Updated in the last three days: updated:>2024-07-15.