Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Anyone has success with localAI? #56

Closed
mounta11n opened this issue Jul 9, 2023 · 2 comments
Closed

Anyone has success with localAI? #56

mounta11n opened this issue Jul 9, 2023 · 2 comments

Comments

@mounta11n
Copy link

Describe the bug
ChatWizard does communicate with LocalAI, but a response is still not appearing.

To Reproduce
Steps to reproduce the behavior:

  1. Start localAI
  2. Start ChatWizard
  3. In ChatWizard configure localAI as a forward URL like for example http:https://127.0.0.1:8080
  4. In ChatWizard edit the models list and add a name of a model that is inside localAI's models folder (with extension, for example WizardLM_Uncen-7B-q5K.bin)
  5. Start a new chat and choose the local model

Expected behavior
In your terminal window, where localAI is running, you should see that it correctly starts loading the model. But a response will never arrive at ChatWizard

Screenshots
Imgur

App Info:
Copy from app about:

  • App Version: [Version 0.4.0 (20230709.113618)]
  • Platform: [darwin]
  • OS Type: [Darwin]
  • OS Version: [13.2 (22D49)]
  • OS Arch: [x64]

Would be cool if anyone has figured out what the problem is and how to solve it.

@lisiur
Copy link
Owner

lisiur commented Jul 10, 2023

Are you using this one? https://github.com/go-skynet/LocalAI

I have reproduced it locally and fixed it.

@lisiur lisiur closed this as completed in d8149a1 Jul 10, 2023
@mounta11n
Copy link
Author

Oh wow, that was incredibly fast! I've installed 0.4.1 and it is working like a charm now. Thanks very much : )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants