Commits

Commits on Sep 20, 2023

integrated flash attention 2 (#1035 )
a663E-36z1120
committedSep 20, 2023

Commits on Sep 18, 2023

Fix SequentialWrapper Generation (pipe_parallel_size = 0) (#1031 )
xu-song
committedSep 18, 2023
Remove support for lazy dataset implementation (#1033 )

committedSep 18, 2023
Fix bf16 for zero > 0 and pipeline parallelism > 0 (#1032 )

dashstander
and
github-actions
committedSep 18, 2023

Commits on Sep 15, 2023

Add llama generation script (#1030 )
xu-song
committedSep 15, 2023
Rename README_llama.md to README.md (#1028 )
Quentin-Anthony
committedSep 15, 2023
Create README_llama.md (#1027 )
Quentin-Anthony
committedSep 15, 2023
add llama training config (#1023 )
xu-song
committedSep 15, 2023
Fix broken link (#1022 )

committedSep 15, 2023
Fix Generation with Sequential Model (#1026 )
xu-song
committedSep 15, 2023

Commits on Sep 13, 2023

Bump transformers version and update enwik8 link (#1024 )

dashstander
and
github-actions
committedSep 13, 2023

Commits on Aug 28, 2023

README Update (#1017 )

committedAug 28, 2023

Commits on Aug 22, 2023

Update Dockerfile (#1014 )
xu-song
committedAug 22, 2023

Commits on Aug 12, 2023

turn hyphens into underscores in merge20b.py (#986 )
wunderalbert
committedAug 12, 2023
Fixed final value of cosine decay lr (#1011 )

kshitijkg
and
github-actions
committedAug 12, 2023

Commits on Aug 7, 2023

Fixed AnnealingLR Class and Cosine Decay Schedule (#1008 )

kshitijkg
and
github-actions
committedAug 7, 2023

Commits on Jul 26, 2023

format docs/s and MB/s (#1002 )
xu-song
committedJul 26, 2023

Commits on Jul 18, 2023

Merge pull request #996 from mariebiscuit/main
StellaAthena
committedJul 18, 2023

Commits on Jul 17, 2023

changed all instances of torch.concat to torch.cat
mariebiscuit
committedJul 17, 2023

Commits on Jul 8, 2023

Merge pull request #993 from mayankjobanputra/patch-1
StellaAthena
committedJul 8, 2023
default tokenizer_type should be string
mayankjobanputra
committedJul 8, 2023

Commits on Jul 6, 2023

Merge pull request #979 from EleutherAI/dataloadFix
StellaAthena
committedJul 6, 2023

Commits on Jul 5, 2023

Update NeoXArgs docs automatically
github-actions
committedJul 5, 2023
Update training.py
StellaAthena
committedJul 5, 2023
Update NeoXArgs docs automatically
github-actions
committedJul 5, 2023
Update data_utils.py
StellaAthena
committedJul 5, 2023
Update NeoXArgs docs automatically
github-actions
committedJul 5, 2023
Delete enwik8.zip
StellaAthena
committedJul 5, 2023

Commits on Jun 23, 2023

Update NeoXArgs docs automatically
github-actions
committedJun 23, 2023
Merge branch 'main' into dataloadFix
Quentin-Anthony
committedJun 23, 2023

Commits on Jun 22, 2023

Update gpt2_dataset.py (#974 )

StellaAthena
and
github-actions
committedJun 22, 2023
Fix setup README and tensorboard version (#975 )
Taishi-N324
committedJun 22, 2023
Update NeoXArgs docs automatically
github-actions
committedJun 22, 2023
change configs
Quentin TastyRice
committedJun 22, 2023
change configs
Quentin TastyRice
committedJun 22, 2023