You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've made a quick bat file to automatically start LMStudio server + Load the model and then start AnythingLLM.
This works, with one caveat; I can't start the embedding model in LMStudio this way.
@echooff::Starting LMS local API server
lms server start --cors
::Loading a model
lms load Meta-Llama-3-8B-Instruct-Q8_0.gguf --gpu max --identifier Llama-3-8B-Q8-8K
::Start Anything LLMcmd /c start"""%localappdata%\Programs\anythingllm-desktop\AnythingLLM.exe"exit
Would be nice if a next version of lms could be used to load that as well.
The text was updated successfully, but these errors were encountered:
We currently do not support loading/unloading non-LLM's with lms. We will for sure add support for it in the future. I will update here once it is supported.
I've made a quick bat file to automatically start LMStudio server + Load the model and then start AnythingLLM.
This works, with one caveat; I can't start the embedding model in LMStudio this way.
Would be nice if a next version of lms could be used to load that as well.
The text was updated successfully, but these errors were encountered: