-
Notifications
You must be signed in to change notification settings - Fork 982
Pull requests: EleutherAI/gpt-neox
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Adds a script to convert NeoX 2.0 checkpoints to DeepSpeed's universal checkpoint format
merge-queue
This PR is next on the queue to merge
#836
opened Mar 14, 2023 by
dashstander
Loading…
Adding AxoNN's 3D tensor parallelism [WIP]
feature request
New feature or request
#1086
opened Nov 28, 2023 by
siddharth9820
•
Draft
1 of 3 tasks
[Draft] Megatron-LM style Sequence Parallel
#1257
opened Aug 8, 2024 by
haileyschoelkopf
•
Draft
1 of 4 tasks
SFT improvements (labeling fixes, different packing implementations)
#1240
opened Jun 21, 2024 by
dmahan93
Loading…
Add Transformer Engine's version of RMSNorm and LayerNorm
#1235
opened Jun 11, 2024 by
lintangsutawika
•
Draft
Previous Next
ProTip!
What’s not been updated in a month: updated:<2024-07-17.