Commits

Commits on Jul 3, 2024

Add support for Internlm2 (arcee-ai#362 )
Crystalcareai
committedJul 3, 2024

Commits on Jun 29, 2024

Gemma2 support (arcee-ai#359 )
cg123
committedJun 29, 2024
Support Qwen2 models with tied weights (arcee-ai#358 )
cg123
committedJun 29, 2024

Commits on Jun 16, 2024

Fix DBZ Error (arcee-ai#346 )
MonsterAzi
committedJun 16, 2024

Commits on Jun 12, 2024

Add pause after ray shutdown and allow setting initial popsize
cg123
committedJun 12, 2024

Commits on Jun 11, 2024

Add out_dtype option (arcee-ai#347 )
cg123
committedJun 11, 2024

Commits on May 26, 2024

Bump dependencies (arcee-ai#331 )
cg123
committedMay 26, 2024
Fix mergekit-moe for older python (arcee-ai#330 )
cg123
committedMay 26, 2024
mergekit-evolve improvements (arcee-ai#307 )
cg123
committedMay 26, 2024

Commits on May 9, 2024

Fix size check in TensorWriter.save_tensor (arcee-ai#315 )
cg123
committedMay 9, 2024
Fix Qwen MoE architecture check (arcee-ai#313 )
cg123
committedMay 9, 2024
[mergekit-extract-lora] cast to float before running SVD (arcee-ai#314 )

cg123
and
thomasgauthier
committedMay 9, 2024

Commits on May 4, 2024

Add MoE FAQ about --clone-tensors option. (arcee-ai#296 )
PhilipMay
committedMay 4, 2024
Fix BERT merging (arcee-ai#295 )
cg123
committedMay 4, 2024
Add uniform_random gate mode to mergekit-moe (arcee-ai#303 )
cg123
committedMay 4, 2024

Commits on Apr 30, 2024

Add Model Breadcrumbs merge method (arcee-ai#228 )
cg123
committedApr 30, 2024
Add Phi-3 support (arcee-ai#299 )
richardburleigh
committedApr 30, 2024
mergekit-evolve QoL tweaks (arcee-ai#298 )
cg123
committedApr 30, 2024

Commits on Apr 25, 2024

Fix mergekit-evolve crash when not using wandb (arcee-ai#291 )
cg123
committedApr 25, 2024

Commits on Apr 24, 2024

Update README.md w/ correct git clone URL (arcee-ai#278 )
tleyden
committedApr 24, 2024
Link to list of available eval tasks (arcee-ai#289 )
tleyden
committedApr 24, 2024
Fix typo in evolve.md (arcee-ai#288 )
tleyden
committedApr 24, 2024

Commits on Apr 23, 2024

Add mergekit-evolve for parameter space evolutionary algorithm merging (arcee-ai#283 )
cg123
committedApr 23, 2024

Commits on Apr 16, 2024

MoE Merge Rework (arcee-ai#263 )
cg123
committedApr 16, 2024

Commits on Apr 15, 2024

Add BERT, DistilBERT, and RoBERTa (arcee-ai#269 )
cg123
committedApr 15, 2024

Commits on Apr 14, 2024

Switch to argsort over TopK (arcee-ai#265 )

MonsterAzi
and
Azazelle Guice
committedApr 14, 2024

Commits on Apr 9, 2024

Lora extraction (arcee-ai#240 )
thomasgauthier
committedApr 9, 2024

Commits on Apr 8, 2024

added the hugging face spaces GUI link (arcee-ai#255 )
shamanez
committedApr 8, 2024

Commits on Apr 7, 2024

Generic Sparsification Rescaling (arcee-ai#245 )
MonsterAzi
committedApr 7, 2024

Commits on Apr 5, 2024

Fix lazy_unpickle flag not getting propagated (arcee-ai#247 )
cg123
committedApr 5, 2024
Fix calculation of Model Stock interpolation parameter for N>2 (arcee-ai#246 )
cg123
committedApr 5, 2024

Commits on Apr 1, 2024

Use numel() * element_size() instead of nbytes (arcee-ai#233 )
cg123
committedApr 1, 2024

Commits on Mar 31, 2024

Add mergekit-tokensurgeon (arcee-ai#221 )
cg123
committedMar 31, 2024
Make StableLmForCausalLM qkv bias optional (arcee-ai#225 )
cg123
committedMar 31, 2024

Commits on Mar 30, 2024

Fix type annotation error
cg123
committedMar 30, 2024