-
Notifications
You must be signed in to change notification settings - Fork 941
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to easily convert Meta's MMS-ASR models to ggml? #507
Comments
Taking a peek, the MMS-ASR looks very similar to meta Seamlessm4t. The interface binding does expose the ability to run it on CPU. If I look at the script in ASR folder, mms_infer.py calls infer.py in https://github.com/facebookresearch/fairseq/blob/main/examples/speech_recognition/new/infer.py and in line 402, it clearly sets torch to run in CPU if GPU is not found. There are other lines in the script that sets to cpu, which indicate it is possible to run this on CPU without GPU. But iine 418-419, seems to indicate a feature that requires GPU. The only way to find out is to try this on CPU machine. I'm pretty positive that it should work just like seamlessm4t. |
Help needed to convert MMS-ASR models to ggml. It supports more low resource languages. https://github.com/facebookresearch/fairseq/tree/main/examples/mms
https://huggingface.co/facebook/mms-1b-all
The text was updated successfully, but these errors were encountered: