-
Notifications
You must be signed in to change notification settings - Fork 983
Issues: EleutherAI/gpt-neox
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Why we need to average LayerNorm values over mp ranks when converting to HFformat checkpoint?
#983
opened Jun 26, 2023 by
forceshorty
Add Transformer Engine's version of RMSNorm and LayerNorm
#1235
opened Jun 11, 2024 by
lintangsutawika
•
Draft
Implement neox_args processing when OMPI_COMM_WORLD_SIZE>1
#1073
opened Nov 7, 2023 by
kyuheejang
Loading…
SFT improvements (labeling fixes, different packing implementations)
#1240
opened Jun 21, 2024 by
dmahan93
Loading…
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.