Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows: using --verbose prevents ability to load model #38

Open
mferris77 opened this issue Jun 16, 2024 · 0 comments
Open

Windows: using --verbose prevents ability to load model #38

mferris77 opened this issue Jun 16, 2024 · 0 comments

Comments

@mferris77
Copy link

mferris77 commented Jun 16, 2024

Hi and thanks for creating this utility. I was putting together a batch file to run LM Studio so I can connect from a networked machine and was trying out some of the various options to get it started.

My goal is simple: Start the server, load a model, show the logs as activity comes in. Here is the batch file I put together:

@echo off
echo LMS Starting...
lms server start --cors --verbose
timeout 5
echo Loading Model...
lms load <modelname> --gpu max -y
echo Logging LMS stream...
lms log stream

...and executing it via another batch file which kicks off some other processes:

start "LMS" cmd /k lms_start.bat

It would hang at Loading Model.... When I removed --verbose, it worked as expected.

EDIT: I was wrong, and --verbose is not the culprit! It seems simply trying to load the model when launched in a new window causes it to hang. If I run all of the above commands manually, everything works as expected. But when run from a batch file, it hangs when loading the model. I'll try a few more scenarios and will report back to see if one of the flags are the cause.

I thought about deleting this outright but wanted to bring it to the dev's attention as it is still unexpected behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant