Commits

Commits on Jun 7, 2024

Conversion script bugfixes (EleutherAI#1218 )

committedJun 7, 2024

Commits on Mar 15, 2024

Mamba + Tensor Parallel Support (EleutherAI#1184 )

committedMar 15, 2024

Commits on Mar 13, 2024

Switch to using Cuda Flash Attn for Alibi (EleutherAI#1183 )

haileyschoelkopf
and
github-actions
committedMar 13, 2024

Commits on Mar 10, 2024

Add Mamba Architecture (EleutherAI#1157 )

committedMar 10, 2024

Commits on Mar 8, 2024

remove best_download as dependency (EleutherAI#1179 )

haileyschoelkopf
and
github-actions
committedMar 8, 2024

Commits on Mar 4, 2024

Make rotary freqs buffer non-persistent (EleutherAI#1168 )

committedMar 4, 2024

Commits on Mar 2, 2024

Improve argument validation for Flash-attn + SWA (EleutherAI#1162 )

haileyschoelkopf
and
github-actions
committedMar 2, 2024

Commits on Feb 26, 2024

[Bug?] Fix profiling argument names (EleutherAI#1155 )

committedFeb 26, 2024

Commits on Feb 8, 2024

Improve Conversion Utilities (EleutherAI#1124 )

committedFeb 8, 2024

Commits on Feb 1, 2024

Update lm_eval v0.4 to PyPI dependencies (EleutherAI#1141 )

committedFeb 1, 2024

Commits on Jan 19, 2024

Enable passing of --account to srun / SlurmLauncher (EleutherAI#1126 )

haileyschoelkopf
and
github-actions
committedJan 19, 2024

Commits on Dec 23, 2023

Lm eval 0.4.0 support (EleutherAI#1101 )

committedDec 23, 2023

Commits on Nov 1, 2023

Pin version of lm_eval (EleutherAI#1070 )

haileyschoelkopf
and
github-actions
committedNov 1, 2023
Edge-casing for multi-GPU HF-to-NeoX conversion (EleutherAI#1065 )

committedNov 1, 2023

Commits on Sep 23, 2023

Add s3 checkpoint syncing (EleutherAI#1010 )

committedSep 23, 2023

Commits on Jun 5, 2023

Update HF conversion docs following reversion of is_pipe_parallel check (EleutherAI#959 )

haileyschoelkopf
and
github-actions
committedJun 5, 2023

Commits on Apr 13, 2023

Make conversion scripts compatible with Python 3.8 (EleutherAI#877 )

haileyschoelkopf
and
github-actions
committedApr 13, 2023

Commits on Apr 11, 2023

No longer ignore --iteration when passed to train.py (EleutherAI#869 )

committedApr 11, 2023

Commits on Mar 26, 2023

Upstream DeepSpeed -> HF checkpoint conversion script update (EleutherAI#752 )

committedMar 26, 2023

Commits on Mar 23, 2023

Minor Usability Fixes for HF Conversion (EleutherAI#853 )

haileyschoelkopf
and
github-actions
committedMar 23, 2023

Commits on Feb 3, 2023

Default use_cache=False in eval harness integration (EleutherAI#774 )

committedFeb 3, 2023

Commits on Jan 31, 2023

add descriptive errors for unimplemented class methods
haileyschoelkopf
committedJan 31, 2023
add TiktokenTokenizer
haileyschoelkopf
committedJan 31, 2023

Commits on Jan 6, 2023

Bugfix for Iteration 0 checkpointing (EleutherAI#764 )

haileyschoelkopf
and
github-actions
committedJan 6, 2023

Commits on Dec 27, 2022

clean up conditional order
haileyschoelkopf
committedDec 27, 2022
revert 20B.yml gpt_j_tied -> false
haileyschoelkopf
committedDec 27, 2022
fix gpt_j_tied conditional
haileyschoelkopf
committedDec 27, 2022

Commits on Dec 21, 2022

Update slurm_125M.yml
haileyschoelkopf
committedDec 21, 2022
Update gmlp_small.yml
haileyschoelkopf
committedDec 21, 2022
Update bnb_125M.yml
haileyschoelkopf
committedDec 21, 2022
Update bf16_125M.yml
haileyschoelkopf
committedDec 21, 2022
Update 800M.yml
haileyschoelkopf
committedDec 21, 2022
Update 760M.yml
haileyschoelkopf
committedDec 21, 2022
Update 6-7B.yml
haileyschoelkopf
committedDec 21, 2022
Update 49M.yml
haileyschoelkopf
committedDec 21, 2022