Feature Request: 🛠 Support for local LLMs tools in Terminal Chat like Ollama #16471
Labels
Area-Chat
All things LLM or "AI"
Issue-Feature
Complex enough to require an in depth planning process and actual budgeted, scheduled work.
Needs-Tag-Fix
Doesn't match tag requirements
Product-Terminal
The new Windows Terminal.
Milestone
Description of the new feature/enhancement
The Windows Terminal Chat currently only supports Azure OpenAI Service. This restriction limits developers who work with or are developing their own local Large Language Models (LLMs), or using tools such as Ollama and need to interface with them directly within the Terminal.
The ability to connect to a local LLM service would allow for better flexibility, especially for those concerned with privacy, working offline, or dealing with sensitive information that cannot be sent to cloud services.
Proposed technical implementation details (optional)
include functionality to support local LLM services by allowing users to configure a connection to local AI models. This would involve:
Thanks!
The text was updated successfully, but these errors were encountered: