Commits

History for

Commits on May 2, 2024

Update NeoXArgs docs automatically
github-actions
committedMay 2, 2024
Merge branch 'main' into rework-mup
lintangsutawika
committedMay 2, 2024
Merge branch 'rework-mup' of https://github.com/EleutherAI/gpt-neox into rework-mup
lintangsutawika
committedMay 2, 2024
update
lintangsutawika
committedMay 2, 2024
update mup
lintangsutawika
committedMay 2, 2024

Commits on Apr 25, 2024

Fixes a weird typo (#1207 )

StellaAthena
and
github-actions
committedApr 25, 2024

Commits on Apr 24, 2024

Fix flash config for llama2/70B.yml config (#1206 )
Quentin-Anthony
committedApr 24, 2024

Commits on Apr 21, 2024

Update NeoXArgs docs automatically
github-actions
committedApr 21, 2024
Merge branch 'main' into rework-mup
Quentin-Anthony
committedApr 21, 2024

Commits on Apr 1, 2024

making PR triggered CPU test for changes to megatron (#1195 )

committedApr 1, 2024

Commits on Mar 15, 2024

Mamba + Tensor Parallel Support (#1184 )

committedMar 15, 2024

Commits on Mar 13, 2024

Switch to using Cuda Flash Attn for Alibi (#1183 )

haileyschoelkopf
and
github-actions
committedMar 13, 2024

Commits on Mar 10, 2024

Add Mamba Architecture (#1157 )

committedMar 10, 2024

Commits on Mar 8, 2024

Remove gas from Pythia configs (#1181 )
yang
committedMar 8, 2024
remove best_download as dependency (#1179 )

haileyschoelkopf
and
github-actions
committedMar 8, 2024

Commits on Mar 7, 2024

Add MoE (#1129 )

committedMar 7, 2024

Commits on Mar 4, 2024

Make rotary freqs buffer non-persistent (#1168 )

committedMar 4, 2024
Ignore markdown for pre-commit (#1171 )

Quentin-Anthony
and
github-actions
committedMar 4, 2024
Single node Pythia 14M training on ngc pytorch 24.02 container (#1170 )

tf-nv
and
Quentin-Anthony
committedMar 4, 2024

Commits on Mar 2, 2024

Improve argument validation for Flash-attn + SWA (#1162 )

haileyschoelkopf
and
github-actions
committedMar 2, 2024

Commits on Feb 29, 2024

Update NeoXArgs docs automatically
github-actions
committedFeb 29, 2024
update
lintangsutawika
committedFeb 29, 2024
update from main
lintangsutawika
committedFeb 29, 2024
update to follow pre-commit format
lintangsutawika
committedFeb 29, 2024
update config
lintangsutawika
committedFeb 29, 2024
Update cpu_ci.yml (#1159 )

jaimemcc-intel
and
github-actions
committedFeb 29, 2024

Commits on Feb 28, 2024

update
lintangsutawika
committedFeb 28, 2024

Commits on Feb 27, 2024

Update NeoXArgs docs automatically
github-actions
committedFeb 27, 2024
seperate sp and mup configs
lintangsutawika
committedFeb 27, 2024
Update NeoXArgs docs automatically
github-actions
committedFeb 27, 2024
Merge branch 'main' into rework-mup
lintangsutawika
committedFeb 27, 2024
changeoutput layer to normal
lintangsutawika
committedFeb 27, 2024

Commits on Feb 26, 2024

[Bug?] Fix profiling argument names (#1155 )

committedFeb 26, 2024
Update NeoXArgs docs automatically
github-actions
committedFeb 26, 2024
Merge branch 'main' into rework-mup
lintangsutawika
committedFeb 26, 2024