New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for starcoder plus and starchat beta #241

Closed

aseok opened this issue Jun 9, 2023 · 4 comments

aseok commented Jun 9, 2023

No description provided.

Contributor

TheBloke commented Jun 9, 2023 •

edited

Loading

This repo already has support for starcoder plus and starchat beta!

I quantised and uploaded them last night, using https://github.com/ggerganov/ggml/blob/master/examples/starcoder/convert-hf-to-ggml.py and https://github.com/ggerganov/ggml/blob/master/examples/starcoder/quantize.cpp :)

https://huggingface.co/TheBloke/starcoder-GGML
https://huggingface.co/TheBloke/starcoderplus-GGML
https://huggingface.co/TheBloke/starchat-beta-GGML

m1chae1bx commented Jun 9, 2023

Hello @TheBloke can you also help quantize https://huggingface.co/VMware/open-llama-7b-open-instruct?

Contributor

TheBloke commented Jun 9, 2023

https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GPTQ
https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GGML

GGML is still uploading as I write this - should all be there in another 15-20 mins or so.

m1chae1bx commented Jun 9, 2023

Wonderful! Thank you so much 🙏

aseok closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment