-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Automatically convert pytorch model to ggml #756
Comments
I think what should exist is documentation of the functions in ggml and their equivalents in PyTorch, and then each person can figure out how to port any model. The above is more realistic than creating a program that magically reads an entire PyTorch project and converts the models into a ggml executable and gguf model. |
This is surprisingly non trivial because pytorch models often have a variable computational graph defined at runtime based on conditional logic. |
Interesting. How does onnx handle variable computation graphs? |
How about .onnx model? Is there any way can convert .onnx model to gguf format automatically? |
Is there a way to automatically convert any pytorch model and its functionality to gguf format + ggml framework? Has anyone worked on such a feature?
The text was updated successfully, but these errors were encountered: