Commits

Commits on May 16, 2023

Remove duplicate deepspeed config arg and allow users to force multinode exec
Quentin-Anthony
committedMay 16, 2023

Commits on May 2, 2023

Fix minor issues with config option defaults, and indentation error in calculate_derived
Quentin-Anthony
committedMay 2, 2023
Disable row-parallelism for now because it's broken (EleutherAI#905 )
Quentin-Anthony
committedMay 2, 2023

Commits on Mar 27, 2023

Add the merge dataset tool from upstream megatron (EleutherAI#855 )

committedMar 27, 2023

Commits on Mar 18, 2023

Move conditional tiktoken import to the __init__ func (EleutherAI#842 )

Quentin-Anthony
and
github-actions
committedMar 18, 2023

Commits on Mar 15, 2023

Commits on Mar 14, 2023

Updated some lingering references to old configs (EleutherAI#830 )

committedMar 14, 2023
Merge branch 'main' into fused-kernels-msg
Quentin-Anthony
committedMar 14, 2023
Change default dataset from enron to enwik8 (EleutherAI#833 )

Quentin-Anthony
and
github-actions
committedMar 14, 2023
Formatting Cleanup (EleutherAI#832 )

committedMar 14, 2023
Remove duplicate no_ssh_check arg (EleutherAI#831 )

committedMar 14, 2023
Prototype fix of large-bs dataloader
Quentin-Anthony
committedMar 14, 2023

Commits on Mar 10, 2023

Make wording a bit more vague in case kernels are installed but broken
Quentin-Anthony
committedMar 10, 2023
Update fused kernel error recommendation, and make error more verbose
Quentin-Anthony
committedMar 10, 2023
Add 2.0 release to README
Quentin-Anthony
committedMar 10, 2023

Commits on Mar 9, 2023

Curriculum Learning Support (EleutherAI#695 )

committedMar 9, 2023

Commits on Mar 7, 2023

remove duplicate mpi4py
Quentin-Anthony
committedMar 7, 2023

Commits on Mar 3, 2023

Commits on Feb 14, 2023

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedFeb 14, 2023

Commits on Jan 15, 2023

Merge branch 'main' into opt-embeddings-fix
Quentin-Anthony
committedJan 15, 2023

Commits on Dec 17, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedDec 17, 2022

Commits on Dec 8, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedDec 8, 2022
Merge branch 'main' into opt-embeddings-fix
Quentin-Anthony
committedDec 8, 2022
Revert "Update NeoXArgs docs automatically"
Quentin-Anthony
committedDec 8, 2022
Update pull_request.yml
Quentin-Anthony
committedDec 8, 2022
Merge branch 'main' into opt-embeddings-fix
Quentin-Anthony
committedDec 8, 2022

Commits on Nov 27, 2022

Fix learned and sinusoidal embeddings after OPT regression
Quentin-Anthony
committedNov 27, 2022

Commits on Nov 25, 2022

Deprecate cpu_offload zero_optimization Option (EleutherAI#720 )

Quentin-Anthony
and
github-actions
committedNov 25, 2022

Commits on Nov 4, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedNov 4, 2022

Commits on Sep 22, 2022

Merge pull request EleutherAI#680 from dashstander/srun
Quentin-Anthony
committedSep 22, 2022

Commits on Sep 21, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
committedSep 21, 2022

Commits on Sep 19, 2022

Update the pre-commit
Quentin-Anthony
committedSep 19, 2022

Commits on Sep 12, 2022

Remove deprecated deepspeed.utils.distributed call
Quentin-Anthony
committedSep 12, 2022