Skip to content

Tags: anzz1/alpaca.cpp

Tags

master-65f165f

Toggle master-65f165f's commit message
removing random prompt generation

master-236c6c0

Toggle master-236c6c0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #2 from anzz1/ci_test

CI fine tuning

master-7ee59d2

Toggle master-7ee59d2's commit message
Q4_1 quantization (antimatter15#193)

* Add AVX2 version of ggml_vec_dot_q4_1

* Small optimisations to q4_1 dot product (@Const-me)

* Rearrange Q4_1 quantization to work for multipart models. (Fix antimatter15#152)

* Fix ggml_vec_mad_q4_1 too

* Fix non-vectorised q4_1 vec mul