Feature Request: Host LM Studio on server and Multi-GPU Support

[mattiasghodsian]

Feature Request 1: Host LM Studio on Ubuntu Server
I would like to request the ability to host LM Studio on an server (not the local API). This feature would allow users to access the application via HTTP, with all components running directly on the server.

Feature Request 2: Multi-GPU Support with LLM Split
Multiple GPUs with an LLM split feature. This would enhance performance and efficiency when handling large models or workloads. I have a few AMD 580 8GB and would be great to use them for this.

[IvanDimanov-OfficeRnD]

This sounds like a fantastic idea! ⭐
I was wondering if we can make a Docker image out of LM Studio 🐳

I'm using RunPod for my models
and was wondering if we can run lms there 🤔

[mattiasghodsian]

This sounds like a fantastic idea! ⭐ I was wondering if we can make a Docker image out of LM Studio 🐳

I'm using RunPod for my models and was wondering if we can run lms there 🤔

I did look in to make a docker container but i don't really have time to explore that right now

[IvanDimanov-OfficeRnD]

I did look in to make a docker container but i don't really have time to explore that right now

Well, if we can make LM Studio run on Ubuntu
and make it fully utilise the given hardware
then, perhaps, I can try to make a docker image out of it.

I'm open for ideas how we can deploy lms on AWS, GAE, Azure, etc.

[IvanDimanov-OfficeRnD]

I did look in to make a docker container but i don't really have time to explore that right now

Last time when I tried to install the LM Studio AppFile on docker
I got into all sorts of issues on running dbus ...

Not sure how to resolve it
but maybe someone can also have a look should we be able to run lms on Ubuntu Server 🙂