-
Notifications
You must be signed in to change notification settings - Fork 982
Pull requests: EleutherAI/gpt-neox
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Implement neox_args processing when OMPI_COMM_WORLD_SIZE>1
#1073
opened Nov 7, 2023 by
kyuheejang
Loading…
Added infinite lr schedules
merge-queue
This PR is next on the queue to merge
#1194
opened Mar 25, 2024 by
kshitijkg
Loading…
Add Transformer Engine's version of RMSNorm and LayerNorm
#1235
opened Jun 11, 2024 by
lintangsutawika
•
Draft
SFT improvements (labeling fixes, different packing implementations)
#1240
opened Jun 21, 2024 by
dmahan93
Loading…
[Draft] Megatron-LM style Sequence Parallel
#1257
opened Aug 8, 2024 by
haileyschoelkopf
•
Draft
1 of 4 tasks
ProTip!
Filter pull requests by the default branch with base:main.