We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Is your feature request related to a problem? Please describe. Yes - Running Ollama on my M2 Mac it times out.
time=2024-07-30T15:28:09.584-10:00 level=DEBUG msg="span start" name=ollama/llama3.1:70b time=2024-07-30T15:28:39.592-10:00 level=DEBUG msg="span end" name=ollama/llama3.1:70b time=2024-07-30T15:28:39.592-10:00 level=DEBUG msg=Action.Run name=0x22e13a0 output=(*ai.GenerateResponse)(nil) err="failed to send request: Post \"https://127.0.0.1:11434/api/generate\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" time=2024-07-30T15:28:39.601-10:00 level=DEBUG msg="span end" name=dev-run-action-wrapper time=2024-07-30T15:28:39.602-10:00 level=ERROR msg="request end" reqID=9 err="failed to send request: Post \"https://127.0.0.1:11434/api/generate\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Describe the solution you'd like Either a longer timeout - 1000s or better a configurable timeout.
Describe alternatives you've considered It appears to be set here
Additional context
I'm really enjoying using this. Thanks.
The text was updated successfully, but these errors were encountered:
If you'd be receptive to a PR, I'd propose modifying genkit/go/plugins/ollama/ollama.go:
genkit/go/plugins/ollama/ollama.go
Timeout int
type Config
timeout int
var state struct
Init
Sorry, something went wrong.
alonsopec89
Successfully merging a pull request may close this issue.
Is your feature request related to a problem? Please describe.
Yes - Running Ollama on my M2 Mac it times out.
Describe the solution you'd like
Either a longer timeout - 1000s or better a configurable timeout.
Describe alternatives you've considered
It appears to be set here
Additional context
I'm really enjoying using this. Thanks.
The text was updated successfully, but these errors were encountered: