Commits

Commits on Jan 26, 2021

Miscellaneous docker QoL improvements (EleutherAI#91 )
leogao2
committedJan 26, 2021
Update base_model.json (EleutherAI#93 )
srulikbd
committedJan 26, 2021

Commits on Jan 25, 2021

Fix train pipeline (EleutherAI#89 )

sdtblck
and
StellaAthena
committedJan 25, 2021

Commits on Jan 23, 2021

Batch size needs to be specified (EleutherAI#87 )
joshlk
committedJan 23, 2021
Implement distributed training using Kubernetes (EleutherAI#77 )

leogao2
and
StellaAthena
committedJan 23, 2021
Minor fixes (EleutherAI#85 )
sdtblck
committedJan 23, 2021
Merge pull request EleutherAI#84 from srulikbd/requirements
sdtblck
committedJan 23, 2021
Update requirements.txt
sdtblck
committedJan 23, 2021
Update train.py
sdtblck
committedJan 23, 2021
Merge pull request EleutherAI#81 from EleutherAI/StellaAthena-patch-1
sdtblck
committedJan 23, 2021
Merge pull request EleutherAI#83 from EleutherAI/StellaAthena-patch-2
sdtblck
committedJan 23, 2021
Update requirements.txt
srulikbd
committedJan 23, 2021
updated deepspeed_zero2 with recommended settings
StellaAthena
committedJan 23, 2021
Update issue templates
StellaAthena
committedJan 23, 2021
Merge pull request EleutherAI#78 from EleutherAI/StellaAthena-patch
leogao2
committedJan 23, 2021
Update deepspeed_zero1.json
StellaAthena
committedJan 23, 2021
Update deepspeed_zero1.json
StellaAthena
committedJan 23, 2021
Update deepspeed_zero2.json
StellaAthena
committedJan 23, 2021
Update deepspeed_zero2.json
StellaAthena
committedJan 23, 2021
removed errant comma (EleutherAI#79 )
StellaAthena
committedJan 23, 2021
Removed errant comma
StellaAthena
committedJan 23, 2021
Merge pull request EleutherAI#72 from EleutherAI/StellaAthena-patch-1
leogao2
committedJan 23, 2021

Commits on Jan 22, 2021

Update train_enwik8_pipeline.sh
StellaAthena
committedJan 22, 2021
Update train_gpt3small_pipeline.sh
StellaAthena
committedJan 22, 2021

Commits on Jan 19, 2021

Merge pull request EleutherAI#74 from EleutherAI/leogao2-patch-1
lucidrains
committedJan 19, 2021
Remove -s flag
leogao2
committedJan 19, 2021
Merge pull request EleutherAI#73 from EleutherAI/leogao2-patch-1
sdtblck
committedJan 19, 2021
Update deepspeed install script to allow being run as root
leogao2
committedJan 19, 2021

Commits on Jan 18, 2021

Update train_pipeline.py
StellaAthena
committedJan 18, 2021
Update train_pipeline.py
StellaAthena
committedJan 18, 2021
Update train_pipeline.py
StellaAthena
committedJan 18, 2021
changed to zero1
StellaAthena
committedJan 18, 2021
Added 1-bit adam
StellaAthena
committedJan 18, 2021
Added one-bit adam
StellaAthena
committedJan 18, 2021
Updated config to avoid ZeRO 2
StellaAthena
committedJan 18, 2021