Commits

History for

Commits on Mar 17, 2022

fix: gpu tests, disable failing ones (for now)
Mistobaan
committedMar 17, 2022

Commits on Feb 12, 2022

Add black code formatting to CI (EleutherAI#530 )
Mistobaan
committedFeb 12, 2022

Commits on Oct 24, 2021

Rename pretrain.py to train.py
StellaAthena
committedOct 24, 2021

Commits on Feb 3, 2021

Initial commit
StellaAthena
committedFeb 3, 2021
add evaluation (EleutherAI#110 )

committedFeb 3, 2021

Commits on Feb 1, 2021

Monitoring using wandb (EleutherAI#108 )
joshlk
committedFeb 1, 2021

Commits on Jan 23, 2021

Update train.py
sdtblck
committedJan 23, 2021

Commits on Jan 13, 2021

simplify
sdtblck
committedJan 13, 2021
implement gradient checkpointing
sdtblck
committedJan 13, 2021

Commits on Jan 5, 2021

fix train data path
sdtblck
committedJan 5, 2021
add dataset preparation to main train scripts
sdtblck
committedJan 5, 2021
cleanup
sid
committedJan 5, 2021
add class for automatically downloading datasets
sdtblck
committedJan 5, 2021

Commits on Jan 4, 2021

add download of owt2
steven-mi
committedJan 4, 2021
add download of owt2
steven-mi
committedJan 4, 2021

Commits on Dec 27, 2020

convert IterableDataset to torch.Dataset
sid
committedDec 27, 2020
update scripts, configs & defaults
sid
committedDec 27, 2020
add tfrecords train script and gpt3_small config
sid
committedDec 27, 2020

Loading