Commits

Commits on Jan 5, 2024

cleanup docker build/test
winglian
committedJan 5, 2024
don't bother with latest tag for test
winglian
committedJan 5, 2024
fix the collator to be the max length for multipack pretraining
winglian
committedJan 5, 2024
fix hardcoded data collator fix for multipack pretraining
winglian
committedJan 5, 2024
update test for updated pretraining multipack code
winglian
committedJan 5, 2024
fix dict check
winglian
committedJan 5, 2024
fix up hadrcoding, lint
winglian
committedJan 5, 2024
WIP make continued pretraining work w multipack
winglian
committedJan 5, 2024
[Feat] streaming multipack

[email protected]
authored and
winglian
committedJan 5, 2024
Update tests-docker.yml (OpenAccess-AI-Collective#1052 ) [skip ci]
hamelsmu
committedJan 5, 2024
feat: always push checkpoint to hub if set (OpenAccess-AI-Collective#1049 ) [skip ci]
NanoCode012
committedJan 5, 2024
feature: better device mapping for large models (OpenAccess-AI-Collective#918 )

committedJan 5, 2024
set default for merge (OpenAccess-AI-Collective#1044 )
hamelsmu
committedJan 5, 2024
fix model card upload for PEFT models (OpenAccess-AI-Collective#1043 )
hamelsmu
committedJan 5, 2024

Commits on Jan 4, 2024

RL/DPO (OpenAccess-AI-Collective#935 )
winglian
committedJan 4, 2024
Added chatglm3 conversation type for training models like TinyLLama (OpenAccess-AI-Collective#1036 )
xaviviro
committedJan 4, 2024

Commits on Jan 3, 2024

Commits on Jan 2, 2024

use recommended setting for use_reentrant w gradient checkpointing (OpenAccess-AI-Collective#1021 )
winglian
committedJan 2, 2024

Commits on Dec 29, 2023

Fix: bf16 support for inference (OpenAccess-AI-Collective#981 )

taziksh
and
winglian
committedDec 29, 2023
Adds chat templates (OpenAccess-AI-Collective#1022 )
mhenrichsen
committedDec 29, 2023
[WandB] Push axolotl config to top level wandb files (OpenAccess-AI-Collective#1014 )
hamelsmu
committedDec 29, 2023
add ultrachat prompt strategies (OpenAccess-AI-Collective#996 )
winglian
committedDec 29, 2023
feat: expose bnb kwargs (OpenAccess-AI-Collective#1018 )

NanoCode012
and
hamelsmu
committedDec 29, 2023
feat: remove need to add load_in* during merge (OpenAccess-AI-Collective#1017 )
NanoCode012
committedDec 29, 2023
[Docs] Nit: Remind people to auth to wandb if they are going to use it (OpenAccess-AI-Collective#1013 )
hamelsmu
committedDec 29, 2023
Update README.md (OpenAccess-AI-Collective#1012 )
hamelsmu
committedDec 29, 2023

Commits on Dec 28, 2023

Commits on Dec 27, 2023

FEAT: add tagging support to axolotl (OpenAccess-AI-Collective#1004 )

younesbelkada
and
winglian
committedDec 27, 2023