-
Notifications
You must be signed in to change notification settings - Fork 44
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for GBNF Grammars #31
Comments
We also need this, and I have tried to add the support for it, but it is not working as expected, so maybe I am not calling it when it should be called, so probably we need someone who knows this integration better |
I would also be interested in this. Or similar way to restrict the output to a specific format using the rust bindings. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Llama.cpp has had support for BNF style grammars for a while, but I don't see how I can use them with these bindings.
Is there a way?
If not, is there a good starting place for hooking them up? I could take a whack at trying to get it set up, but I don't know a lot about cpp <-> rust bindings
The text was updated successfully, but these errors were encountered: