Commits

History for

Commits on Mar 18, 2023

Add jsrun launcher based on neox 2.0
Quentin-Anthony
committedMar 18, 2023

Commits on Mar 14, 2023

Updated some lingering references to old configs (#830 )

authoredMar 14, 2023
Remove duplicate no_ssh_check arg (#831 )

authoredMar 14, 2023

Commits on Mar 10, 2023

Update deepspeed_args.py (#823 )
GregorySenay
authoredMar 10, 2023

Commits on Mar 9, 2023

Simplify and relax dependencies (Take 2) (#818 )

EricHallahan
and
Quentin-Anthony
authoredMar 9, 2023
Implement DeepSpeed Main autotuning for NeoX (#739 )

authoredMar 9, 2023
Curriculum Learning Support (#695 )

authoredMar 9, 2023

Commits on Feb 14, 2023

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredFeb 14, 2023
no_ssh_check is a new DeepSpeed command line argument that is important for using the SlurmRunner
dashstander
committedFeb 14, 2023

Commits on Feb 3, 2023

Small changes for MosaicML cloud usage (#778 )
dakinggg
authoredFeb 3, 2023

Commits on Jan 31, 2023

add TiktokenTokenizer
haileyschoelkopf
committedJan 31, 2023

Commits on Dec 25, 2022

Enable multiline prompts by setting a custom prompt end (#754 )

kabachuha
and
Quentin-Anthony
authoredDec 25, 2022

Commits on Dec 17, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredDec 17, 2022

Commits on Dec 14, 2022

Allow specifying arbitrary step numbers for saving extra checkpoints (#737 )

authoredDec 14, 2022

Commits on Dec 10, 2022

Mup Support (#704 )

authoredDec 10, 2022
Add support for Flash attention (#725 )

authoredDec 10, 2022

Commits on Dec 8, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredDec 8, 2022

Commits on Dec 6, 2022

Slurm Fix and formatting (#729 )

authoredDec 6, 2022
align gpt-j layernorm to hf (#481 )

authoredDec 6, 2022

Commits on Dec 2, 2022

Update template.py
StellaAthena
authoredDec 2, 2022
Update neox_args.py
StellaAthena
authoredDec 2, 2022
Update deepspeed_args.py
StellaAthena
authoredDec 2, 2022
Update arguments.py
StellaAthena
authoredDec 2, 2022

Commits on Nov 25, 2022

Deprecate cpu_offload zero_optimization Option (#720 )

Quentin-Anthony
and
github-actions
authoredNov 25, 2022

Commits on Nov 4, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredNov 4, 2022

Commits on Sep 21, 2022

Add deepspeed_slurm config, update config README, and run pre-commit
dashstander
committedSep 21, 2022

Commits on Sep 20, 2022

New comment
dashstander
committedSep 20, 2022

Commits on Sep 19, 2022

User SLURM environment variables
dashstander
committedSep 19, 2022

Commits on Sep 15, 2022

Merge branch 'main' into deepspeed_main
StellaAthena
authoredSep 15, 2022

Commits on Sep 13, 2022

set hostfile in get_deepspeed_main_args
haileyschoelkopf
committedSep 13, 2022

Commits on Sep 12, 2022

Remove deprecated deepspeed.utils.distributed call
Quentin-Anthony
authoredSep 12, 2022

Commits on Sep 9, 2022

Merge branch 'main' into deepspeed_main
Quentin-Anthony
authoredSep 9, 2022

Commits on Sep 8, 2022

Merge pull request #637 from Kyle1668/Kyle1668/get_logits_from_generation
StellaAthena
authoredSep 8, 2022

Commits on Sep 5, 2022

Resolve Hostfile CLI Param Overwriting Config Value
Kyle1668
committedSep 5, 2022

Commits on Sep 2, 2022

Pass args fix and update reqs
anthony.301
committedSep 2, 2022