When using RancherDesktop, can't connect to the Ollama server on my host

[ppasieka]

Bug Report

Description

Bug Summary:
I use RancherDesktop to run docker containers (it is the licensing thing, I can't switch to Docker Desktop). I can pull and start the container, but I can't connect to the Ollama server running on my host machine

Steps to Reproduce:
Follow installation steps from readme:

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Expected Behavior:
Can connect to ollama server, list installed models, trigger inference

Actual Behavior:
Error when starting the Open WebUI (see screenshot)

Environment

• Open WebUI Version: 0.1.125

• Ollama (if applicable): 0.1.38

• Operating System: [Windows 10]

• Browser (if applicable): any browser

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.

Logs and Screenshots

Loading WEBUI_SECRET_KEY from .webui_secret_key
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on https://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     172.17.0.1:53572 - "GET / HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/entry/start.4d0d7042.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/scheduler.f6668761.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/singletons.105b85e5.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/index.afef706d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/index.65c87b32.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/entry/app.62dc7e6b.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/0.9b2c9561.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/Toaster.svelte_svelte_type_style_lang.4f4e956a.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/constants.c3d2104f.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/navigation.6ed5731e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/assets/Toaster.3a6d0da3.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c122cac0.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/each.2cd6bd47.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/assets/0.de36d200.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/assets/2.c7820e19.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/assets/index.8a27bb7e.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c4d7520e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/1.acdc58d4.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/stores.46842bc6.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/nodes/2.7711eee9.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/FileSaver.min.898eb36f.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/_commonjsHelpers.de833af9.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.24d0f459.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/chunks/index.69f6ab4e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/index.15f26e66.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/Modal.68c1a0a5.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/index.b7ffcff4.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/AdvancedParams.020cee97.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.94bf9275.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/chunks/index.3f5e7a6d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/nodes/3.113d8beb.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/index.f3d17e4d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/index.4987a420.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/Tags.4457bfcc.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/dayjs.min.1e504c00.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /assets/fonts/Arimo-Variable.ttf HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /favicon.png HTTP/1.1" 200 OK
INFO:     172.17.0.1:53614 - "GET /manifest.json HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /themes/rosepine.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /themes/rosepine-dawn.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/13.a8c7da85.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/assets/13.e43bb62b.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /assets/fonts/Mona-Sans.woff2 HTTP/1.1" 200 OK
insert_new_auth
INFO:     172.17.0.1:46504 - "POST /api/v1/auths/signup HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
https://api.openai.com/v1/models
INFO:     172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
INFO:     172.17.0.1:46504 - "GET /user.png HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/auths/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
https://api.openai.com/v1/models
INFO:     172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
INFO:     172.17.0.1:49436 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/auths/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:49438 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:49436 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:49436 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
https://api.openai.com/v1/models
INFO:     172.17.0.1:49436 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized

Installation Method

Docker

Notes

I suspect differences in how networks are setup in Rancher Desktop and Docker Desktop.

[knkarthik]

Explicitly mapping the Ollama port works for me:

docker run -d -p 3000:8080 -p 11434:11434 -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main