Commits

History for

Commits on May 19, 2023

Remove row parallelism (#946 )

committedMay 19, 2023

Commits on May 18, 2023

Updates bf16 demo config and mixed precision docutmentation. (#941 )

dashstander
and
github-actions
committedMay 18, 2023

Commits on May 16, 2023

Remove duplicate deepspeed config arg and allow users to force multinode exec
Quentin-Anthony
committedMay 16, 2023
Add DeepSpeed bf16 configuration (#787 )

committedMay 16, 2023

Commits on May 9, 2023

Merge pull request #928 from austinburnett/bug/consistentConfigs
StellaAthena
committedMay 9, 2023
[Fix] pre-commit and update-documentation checks
austinburnett
committedMay 9, 2023
fix bug for flash attention (#910 )
liamcli
committedMay 9, 2023
[bug-fix] enable finetuning option(set optimizer params correctly) (#927 )

taegyeongeo
and
logan.eo
committedMay 9, 2023

Commits on May 2, 2023

Commits on Apr 21, 2023

feat: improve typing
SauravMaheshkar
committedApr 21, 2023
Changed is_pipe_parallel setting to fix pipeline-parallel inference (#866 )

committedApr 21, 2023

Commits on Apr 19, 2023

Fix pre-commit formatting
dashstander
committedApr 19, 2023
Just remove clear_cache
dashstander
committedApr 19, 2023

Commits on Apr 18, 2023

Comment out clear_cache
dashstander
committedApr 18, 2023
Split up FlashAttention methods
dashstander
committedApr 18, 2023
Set training attribute appropriately
dashstander
committedApr 18, 2023
errors
dashstander
committedApr 18, 2023
Error
dashstander
committedApr 18, 2023

Commits on Apr 15, 2023

accept changes from main & resolve conflicts
satpalsr
committedApr 15, 2023

Commits on Apr 11, 2023

fix formatting
satpalsr
committedApr 11, 2023

Commits on Mar 29, 2023

add flash_attn_kvpacked
satpalsr
committedMar 29, 2023

Commits on Mar 26, 2023

Extra DeepSpeed Argument Capability (#819 )

committedMar 26, 2023

Commits on Mar 18, 2023

Move conditional tiktoken import to the __init__ func (#842 )

Quentin-Anthony
and
github-actions
committedMar 18, 2023

Commits on Mar 16, 2023

Merge branch 'main' into large_bs_dataloader
StellaAthena
committedMar 16, 2023

Commits on Mar 15, 2023

Allow the dataset builder to choose int32 or int64 at runtime
Quentin-Anthony
committedMar 15, 2023

Commits on Mar 14, 2023

Updated some lingering references to old configs (#830 )

committedMar 14, 2023
Merge branch 'main' into fused-kernels-msg
Quentin-Anthony
committedMar 14, 2023
Formatting Cleanup (#832 )

committedMar 14, 2023
Merge branch 'main' into fused-kernels-msg
StellaAthena
committedMar 14, 2023
Remove duplicate no_ssh_check arg (#831 )

committedMar 14, 2023
Prototype fix of large-bs dataloader
Quentin-Anthony
committedMar 14, 2023