Commits

Commits on Apr 11, 2023

ALibi & Flash Attention (#864 )

committedApr 11, 2023

Commits on Apr 3, 2023

Merge pull request #868 from crazyofapple/main
StellaAthena
committedApr 3, 2023

Commits on Apr 2, 2023

Update transformer.py
crazyofapple
committedApr 2, 2023

Commits on Mar 30, 2023

Fixed previous inability to launch single-node training (#859 )

committedMar 30, 2023

Commits on Mar 27, 2023

Add the merge dataset tool from upstream megatron (#855 )

committedMar 27, 2023

Commits on Mar 26, 2023

Upstream DeepSpeed -> HF checkpoint conversion script update (#752 )

committedMar 26, 2023
Fix ssh login (#825 )
xu-song
committedMar 26, 2023
Extra DeepSpeed Argument Capability (#819 )

committedMar 26, 2023

Commits on Mar 23, 2023

Minor Usability Fixes for HF Conversion (#853 )

haileyschoelkopf
and
github-actions
committedMar 23, 2023

Commits on Mar 21, 2023

Fix README link (#850 )
lihe07
committedMar 21, 2023

Commits on Mar 18, 2023

Move conditional tiktoken import to the __init__ func (#842 )

Quentin-Anthony
and
github-actions
committedMar 18, 2023

Commits on Mar 16, 2023

Merge pull request #835 from EleutherAI/large_bs_dataloader
StellaAthena
committedMar 16, 2023
Merge branch 'main' into large_bs_dataloader
StellaAthena
committedMar 16, 2023
Merge pull request #839 from EleutherAI/curt/update-test-config
StellaAthena
committedMar 16, 2023

Commits on Mar 15, 2023

Commits on Mar 14, 2023

Updated some lingering references to old configs (#830 )

committedMar 14, 2023
Merge pull request #824 from EleutherAI/fused-kernels-msg
StellaAthena
committedMar 14, 2023
Update NeoXArgs docs automatically
github-actions
committedMar 14, 2023
Merge branch 'main' into fused-kernels-msg
Quentin-Anthony
committedMar 14, 2023
Change default dataset from enron to enwik8 (#833 )

Quentin-Anthony
and
github-actions
committedMar 14, 2023
Formatting Cleanup (#832 )

committedMar 14, 2023
Update NeoXArgs docs automatically
github-actions
committedMar 14, 2023
Merge branch 'main' into fused-kernels-msg
StellaAthena
committedMar 14, 2023
Remove duplicate no_ssh_check arg (#831 )

committedMar 14, 2023
Update NeoXArgs docs automatically
github-actions
committedMar 14, 2023
Prototype fix of large-bs dataloader
Quentin-Anthony
committedMar 14, 2023
Added errors for download failure and also a --force-redownload argument (#820 )

committedMar 14, 2023

Commits on Mar 13, 2023

Merge pull request #826 from xu-song/patch-3
StellaAthena
committedMar 13, 2023
Update requirements.txt
xu-song
committedMar 13, 2023

Commits on Mar 10, 2023

Merge pull request #822 from EleutherAI/v2.0-readme
StellaAthena
committedMar 10, 2023
Update NeoXArgs docs automatically
github-actions
committedMar 10, 2023