Commits

Commits on Jul 12, 2023

clean
kyriemao
committedJul 12, 2023
clean
kyriemao
committedJul 12, 2023

Commits on Jul 10, 2023

rename
kyriemao
committedJul 10, 2023
add auxilary script
kyriemao
committedJul 10, 2023
yulan v1
kyriemao
committedJul 10, 2023
add
kyriemao
committedJul 10, 2023

Commits on May 28, 2023

add 65B_v3, v2 config
kyriemao
committedMay 28, 2023

Commits on May 23, 2023

add 65B v1 config to train
kyriemao
committedMay 23, 2023

Commits on May 22, 2023

Commits on May 19, 2023

Remove row parallelism (EleutherAI#946 )

committedMay 19, 2023
Adds a script to convert HF checkpoints to NeoX 2.0 with mp and pp sharding (EleutherAI#907 )

bentherien
and
Quentin-Anthony
committedMay 19, 2023

Commits on May 18, 2023

merge ok, begin new start
kyriemao
committedMay 18, 2023
start
kyriemao
committedMay 18, 2023
start2
kyriemao
committedMay 18, 2023
start
kyriemao
committedMay 18, 2023
Updates bf16 demo config and mixed precision docutmentation. (EleutherAI#941 )

dashstander
and
github-actions
committedMay 18, 2023

Commits on May 17, 2023

Merge pull request EleutherAI#938 from EleutherAI/force_multi
StellaAthena
committedMay 17, 2023
Merge branch 'main' into force_multi
StellaAthena
committedMay 17, 2023
update torch and cuda (EleutherAI#937 )

committedMay 17, 2023

Commits on May 16, 2023

Update NeoXArgs docs automatically
github-actions
committedMay 16, 2023
Remove duplicate deepspeed config arg and allow users to force multinode exec
Quentin-Anthony
committedMay 16, 2023
Add DeepSpeed bf16 configuration (EleutherAI#787 )

committedMay 16, 2023

Commits on May 14, 2023

Merge pull request EleutherAI#936 from EleutherAI/remove-default-password
ShivanshuPurohit
committedMay 14, 2023
Update NeoXArgs docs automatically
github-actions
committedMay 14, 2023
remove password based login for root
AI-WAIFU
committedMay 14, 2023

Commits on May 12, 2023

Re-commit changes (EleutherAI#931 )

committedMay 12, 2023

Commits on May 9, 2023

Merge pull request EleutherAI#928 from austinburnett/bug/consistentConfigs
StellaAthena
committedMay 9, 2023
[Fix] pre-commit and update-documentation checks
austinburnett
committedMay 9, 2023
fix bug for flash attention (EleutherAI#910 )
liamcli
committedMay 9, 2023
[bug-fix] enable finetuning option(set optimizer params correctly) (EleutherAI#927 )

taegyeongeo
and
logan.eo
committedMay 9, 2023
[Bug] Make Configs Consistent
austinburnett
committedMay 9, 2023

Commits on May 2, 2023

Merge pull request EleutherAI#915 from EleutherAI/disable-row-parallel
StellaAthena
committedMay 2, 2023