Commits

History for

Commits on Mar 4, 2024

Single node Pythia 14M training on ngc pytorch 24.02 container (#1170 )

tf-nv
and
Quentin-Anthony
committedMar 4, 2024

Commits on Sep 20, 2023

integrated flash attention 2 (#1035 )
a663E-36z1120
committedSep 20, 2023

Commits on Dec 10, 2022

Add support for Flash attention (#725 )

committedDec 10, 2022

Loading