-
Notifications
You must be signed in to change notification settings - Fork 959
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature request] Add support/demo implementation for Qwen-VL GGUF model #497
Comments
Closing this, as Qwen inference has being added few days ago: |
Sorry for increasing entropy here, just realized, that recently implemented inference is for another model: |
CCLDArjun
pushed a commit
to CCLDArjun/ggml
that referenced
this issue
Dec 18, 2023
* CMake: Add AVX512 option * CI: Add AVX/AVX512 builds (Windows) (AVX512 tests can only be run when the worker happens to support it, building works anyway) * CMake: Fix sanitizer linkage ( merged ggerganov#468 ) * CI: Add sanitizer builds (Ubuntu) * CI: Fix release tagging (change @zendesk/action-create-release to @anzz1/action-create-release until upstream PR Added commitish as input zendesk/action-create-release#32 is merged)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello. May be this can be interesting for future roadmap:
https://github.com/QwenLM/Qwen-VL
It is multimodal and multilangual 7B model, able to analyze image, including text recognition and compare two (at least) images. Also able to detect bounding box of an object within image.
Seems, like it also beats some very good 13B models in pure textual context.
Would be nice to see it running quantized in GGUF.
The text was updated successfully, but these errors were encountered: