Commits

History for

Commits on Dec 18, 2023

lr adjustments is done in train_step to address lr being reset due to lr_scheduling
lintangsutawika
committedDec 18, 2023
remove calling save_base_shapes
lintangsutawika
committedDec 18, 2023

Commits on Dec 6, 2023

lr scale
lintangsutawika
committedDec 6, 2023

Commits on Dec 1, 2023

moved position of mup parameters being processed
lintangsutawika
committedDec 1, 2023
calculate m_width
lintangsutawika
committedDec 1, 2023

Commits on Oct 20, 2023

Lion Optimizer (#1062 )

andylolu2
and
adi-kmt
committedOct 20, 2023

Commits on Oct 17, 2023

LR scheduler fix no longer breaks inference (#1060 )

dashstander
and
github-actions
committedOct 17, 2023

Commits on Sep 27, 2023

Patch LR Annealing Bug (#1046 )

committedSep 27, 2023

Commits on Sep 18, 2023

Fix SequentialWrapper Generation (pipe_parallel_size = 0) (#1031 )
xu-song
committedSep 18, 2023

Commits on Jul 5, 2023

Update training.py
StellaAthena
committedJul 5, 2023

Commits on Jun 21, 2023

fixes
Quentin TastyRice
committedJun 21, 2023
fix issues with dataloading
Quentin TastyRice
committedJun 21, 2023
fix issue with data
Quentin TastyRice
committedJun 21, 2023

Commits on Jun 7, 2023

Adding the possibility of passing a label dataset (#958 )

honglu2875
and
haileyschoelkopf
committedJun 7, 2023

Commits on May 18, 2023

Updates bf16 demo config and mixed precision docutmentation. (#941 )

dashstander
and
github-actions
committedMay 18, 2023

Commits on May 16, 2023

Remove duplicate deepspeed config arg and allow users to force multinode exec
Quentin-Anthony
committedMay 16, 2023

Commits on May 9, 2023

[Fix] pre-commit and update-documentation checks
austinburnett
committedMay 9, 2023

Commits on May 2, 2023

Fix minor issues with config option defaults, and indentation error in calculate_derived
Quentin-Anthony
committedMay 2, 2023

Commits on Apr 11, 2023

No longer ignore --iteration when passed to train.py (#869 )

committedApr 11, 2023

Commits on Mar 14, 2023

Formatting Cleanup (#832 )

committedMar 14, 2023

Commits on Mar 9, 2023

Curriculum Learning Support (#695 )

committedMar 9, 2023

Commits on Feb 14, 2023

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedFeb 14, 2023

Commits on Jan 6, 2023

Bugfix for Iteration 0 checkpointing (#764 )

haileyschoelkopf
and
github-actions
committedJan 6, 2023

Commits on Dec 25, 2022

Enable multiline prompts by setting a custom prompt end (#754 )

kabachuha
and
Quentin-Anthony
committedDec 25, 2022

Commits on Dec 17, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedDec 17, 2022

Commits on Dec 14, 2022

Allow specifying arbitrary step numbers for saving extra checkpoints (#737 )

committedDec 14, 2022

Commits on Dec 10, 2022

Mup Support (#704 )

committedDec 10, 2022

Commits on Dec 2, 2022

Update training.py
StellaAthena
committedDec 2, 2022

Commits on Sep 21, 2022

Add deepspeed_slurm config, update config README, and run pre-commit
dashstander
committedSep 21, 2022

Commits on Sep 12, 2022

Bug Fix: Test Metrics Overwrite Validation Metrics
pwstegman
committedSep 12, 2022

Commits on Mar 17, 2022

fix: gpu tests, disable failing ones (for now)
Mistobaan
committedMar 17, 2022

Commits on Feb 23, 2022

Add codespell
Mistobaan
committedFeb 23, 2022

Commits on Feb 12, 2022

Add black code formatting to CI (#530 )
Mistobaan
committedFeb 12, 2022

Commits on Feb 9, 2022

Fix pp generation (#505 )
sdtblck
committedFeb 9, 2022

Commits on Jan 31, 2022

report eval harness version and do bootstrapping (#498 )
leogao2
committedJan 31, 2022