Commits

Commits on May 16, 2023

Remove duplicate deepspeed config arg and allow users to force multinode exec
Quentin-Anthony
committedMay 16, 2023

Commits on May 2, 2023

Fix minor issues with config option defaults, and indentation error in calculate_derived
Quentin-Anthony
committedMay 2, 2023
Disable row-parallelism for now because it's broken (EleutherAI#905 )
Quentin-Anthony
committedMay 2, 2023

Commits on Mar 27, 2023

Add the merge dataset tool from upstream megatron (EleutherAI#855 )

authoredMar 27, 2023

Commits on Mar 18, 2023

Move conditional tiktoken import to the __init__ func (EleutherAI#842 )

Quentin-Anthony
and
github-actions
authoredMar 18, 2023

Commits on Mar 15, 2023

Commits on Mar 14, 2023

Updated some lingering references to old configs (EleutherAI#830 )

authoredMar 14, 2023
Merge branch 'main' into fused-kernels-msg
Quentin-Anthony
authoredMar 14, 2023
Change default dataset from enron to enwik8 (EleutherAI#833 )

Quentin-Anthony
and
github-actions
authoredMar 14, 2023
Formatting Cleanup (EleutherAI#832 )

authoredMar 14, 2023
Remove duplicate no_ssh_check arg (EleutherAI#831 )

authoredMar 14, 2023
Prototype fix of large-bs dataloader
Quentin-Anthony
committedMar 14, 2023

Commits on Mar 10, 2023

Make wording a bit more vague in case kernels are installed but broken
Quentin-Anthony
committedMar 10, 2023
Update fused kernel error recommendation, and make error more verbose
Quentin-Anthony
committedMar 10, 2023
Add 2.0 release to README
Quentin-Anthony
authoredMar 10, 2023

Commits on Mar 9, 2023

Curriculum Learning Support (EleutherAI#695 )

authoredMar 9, 2023

Commits on Mar 7, 2023

remove duplicate mpi4py
Quentin-Anthony
authoredMar 7, 2023

Commits on Mar 3, 2023

Commits on Feb 14, 2023

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredFeb 14, 2023

Commits on Jan 15, 2023

Merge branch 'main' into opt-embeddings-fix
Quentin-Anthony
authoredJan 15, 2023

Commits on Dec 17, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredDec 17, 2022

Commits on Dec 8, 2022

Commits on Nov 27, 2022

Fix learned and sinusoidal embeddings after OPT regression
Quentin-Anthony
committedNov 27, 2022

Commits on Nov 25, 2022

Deprecate cpu_offload zero_optimization Option (EleutherAI#720 )

Quentin-Anthony
and
github-actions
authoredNov 25, 2022

Commits on Nov 4, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredNov 4, 2022

Commits on Sep 22, 2022

Merge pull request EleutherAI#680 from dashstander/srun
Quentin-Anthony
authoredSep 22, 2022

Commits on Sep 21, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredSep 21, 2022

Commits on Sep 19, 2022

Update the pre-commit
Quentin-Anthony
committedSep 19, 2022

Commits on Sep 12, 2022

Remove deprecated deepspeed.utils.distributed call
Quentin-Anthony
authoredSep 12, 2022