Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] Embedded Ollama within lobechat #2137

Open
LeonXu260 opened this issue Apr 22, 2024 · 5 comments
Open

[Request] Embedded Ollama within lobechat #2137

LeonXu260 opened this issue Apr 22, 2024 · 5 comments
Labels
📝 Documentation Improvements or additions to documentation | 文档问题 🌠 Feature Request New feature or request | 特性与建议 Inactive No response in 30 days | 超过 30 天未活跃

Comments

@LeonXu260
Copy link

🥰 Feature Description

Currently, the Ollama model works by installing ollama separately. https://lobehub.com/docs/usage/providers/ollama

🧐 Proposed Solution

Embed Ollama model within the lobechat docker image or provide instructions on how to install Ollama with a separate docker images.

📝 Additional Information

No response

@LeonXu260 LeonXu260 added the 🌠 Feature Request New feature or request | 特性与建议 label Apr 22, 2024
@lobehubbot
Copy link
Member

👀 @LeonXu260

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

@arvinxx arvinxx added the 📝 Documentation Improvements or additions to documentation | 文档问题 label Apr 22, 2024
@MapleEve
Copy link
Contributor

Ollama 的运行依赖于较大的显存,而 LobeChat 是一个纯前端的 Chatbot,如果有必要,他们应该分开部署。如果仅仅是本地部署, Ollama不应该运行在 Docker 内而是使用其官方的启动器。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Ollama relies on large graphics memory to run, and LobeChat is a pure front-end Chatbot. If necessary, they should be deployed separately. For local deployment only, Ollama should not run inside Docker but use its official launcher.

@arvinxx
Copy link
Contributor

arvinxx commented Apr 23, 2024

我感觉可能的方式是提供一个docker compose的编排文件

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


I think the possible way is to provide a docker compose orchestration file

@lobehubbot lobehubbot added the Inactive No response in 30 days | 超过 30 天未活跃 label Jun 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📝 Documentation Improvements or additions to documentation | 文档问题 🌠 Feature Request New feature or request | 特性与建议 Inactive No response in 30 days | 超过 30 天未活跃
Projects
None yet
Development

No branches or pull requests

4 participants