-
Notifications
You must be signed in to change notification settings - Fork 48
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing parameter "format" in GenerateCompletionRequest #19
Comments
You mean this one?
As it does not support any other values than As for the timeout, you should be able to simply cancel any operation with a CancellationToken. |
timeout I mean, my request take long by design, I'm not using ollama as a chatbot. JSON mode Yes, but it is an optional parameter and you have to provide it if you want to use it right?
|
timeout JSON mode |
Fixed with #22 |
Hi, I'm missing the format parameter for JSON mode in the GenerateCompletionRequest class.
DOC: https://github.com/ollama/ollama/blob/main/docs/api.md
I'm using JSON mode for long running request, 1 request will take up to 5 minutes.
Is there a way to set the timeout?
The text was updated successfully, but these errors were encountered: