Commits

Commits on Jun 7, 2024

Fix changed behavior of pipe_parallel (#1219 )

committedJun 7, 2024

Commits on May 21, 2024

Small tidying (#1222 )

committedMay 21, 2024

Commits on May 4, 2024

Add megablocks dropless MoE (#1192 )

yang
and
Quentin-Anthony
committedMay 4, 2024

Commits on Mar 8, 2024

Fix moe_loss in gpt_j_residual path (#1180 )
yang
committedMar 8, 2024
Remove gas from Pythia configs (#1181 )
yang
committedMar 8, 2024

Commits on Mar 7, 2024

Add MoE (#1129 )

committedMar 7, 2024

Commits on Jan 26, 2024

fused layernorm (#1105 )

yang
and
jahatef
committedJan 26, 2024

Commits on Jan 5, 2024

Fused Rotary Embeddings (fixed) (#1108 )

committedJan 5, 2024

Commits on Jan 4, 2024

Fix install, Dockerfile, CI (#1104 )
yang
committedJan 4, 2024
Fix repo for CI (#1106 )
yang
committedJan 4, 2024