Commits

Commits on May 17, 2023

update torch and cuda (EleutherAI#937 )

committedMay 17, 2023

Commits on May 14, 2023

Merge pull request EleutherAI#936 from EleutherAI/remove-default-password
ShivanshuPurohit
committedMay 14, 2023

Commits on Mar 9, 2023

Update tokenizer.py
ShivanshuPurohit
committedMar 9, 2023
Update neox_arguments.md
ShivanshuPurohit
committedMar 9, 2023

Commits on Jan 9, 2023

Merge pull request EleutherAI#766 from EleutherAI/test_flash
ShivanshuPurohit
committedJan 9, 2023
Merge branch 'deepspeed_main' into test_flash
ShivanshuPurohit
committedJan 9, 2023

Commits on Sep 13, 2022

Merge pull request EleutherAI#671 from EleutherAI/hostfile_fix
ShivanshuPurohit
committedSep 13, 2022

Commits on Aug 12, 2022

Merge pull request EleutherAI#658 from EleutherAI/hostfile_arg
ShivanshuPurohit
committedAug 12, 2022

Commits on Nov 2, 2021

Revert "fix alibi inference shapes for cached layer_past" (EleutherAI#451 )
ShivanshuPurohit
committedNov 2, 2021
Merge pull request EleutherAI#450 from EleutherAI/fix_alibi_inference
ShivanshuPurohit
committedNov 2, 2021

Commits on Sep 29, 2021

Merge pull request EleutherAI#416 from EleutherAI/gptj_residual
ShivanshuPurohit
committedSep 29, 2021

Commits on Aug 24, 2021

Merge pull request EleutherAI#394 from EleutherAI/StellaAthena-patch-1
ShivanshuPurohit
committedAug 24, 2021

Commits on Feb 27, 2021

undoing whatever I did
ShivanshuPurohit
committedFeb 27, 2021
unmatched brackets
ShivanshuPurohit
committedFeb 27, 2021
adding T5 args
ShivanshuPurohit
committedFeb 27, 2021
Update transformer.py
ShivanshuPurohit
committedFeb 27, 2021
Update transformer.py
ShivanshuPurohit
committedFeb 27, 2021
Add T5 rpe args
ShivanshuPurohit
committedFeb 27, 2021
Add T5 rpe args
ShivanshuPurohit
committedFeb 27, 2021
Adding the T5 rpe args
ShivanshuPurohit
committedFeb 27, 2021
Update config_monster.py
ShivanshuPurohit
committedFeb 27, 2021
Typo
ShivanshuPurohit
committedFeb 27, 2021

Commits on Feb 26, 2021

Update README.md
ShivanshuPurohit
committedFeb 26, 2021
Added some definitions.
ShivanshuPurohit
committedFeb 26, 2021

Commits on Feb 25, 2021

Update ds_pretrain_gpt2_medium_pipe.yml
ShivanshuPurohit
committedFeb 25, 2021
make the lr param same in the optimizer and outside
ShivanshuPurohit
committedFeb 25, 2021

Commits on Feb 24, 2021

dividing by num_nodes gives assertion error
ShivanshuPurohit
committedFeb 24, 2021

Commits on Feb 23, 2021

define pipeline parallelism
ShivanshuPurohit
committedFeb 23, 2021

Commits on Feb 16, 2021

Fix typos
ShivanshuPurohit
committedFeb 16, 2021
Fixed typos
ShivanshuPurohit
committedFeb 16, 2021

Commits on Feb 13, 2021

Update ds_zero_stage_1_onebitadam.json
ShivanshuPurohit
committedFeb 13, 2021

Commits on Feb 9, 2021

add zstandard
ShivanshuPurohit
committedFeb 9, 2021
add zstandard
ShivanshuPurohit
committedFeb 9, 2021

Commits on Jan 9, 2021

Update data_utils.py
ShivanshuPurohit
committedJan 9, 2021
Update data_utils.py
ShivanshuPurohit
committedJan 9, 2021