Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed to prepare semantics: 'embedding' #488

Closed
Namec999 opened this issue Jul 6, 2024 · 20 comments
Closed

failed to prepare semantics: 'embedding' #488

Namec999 opened this issue Jul 6, 2024 · 20 comments
Labels
bug Something isn't working module/ai-service ai-service related

Comments

@Namec999
Copy link

Namec999 commented Jul 6, 2024

hello all,

i have a fresh instalaltion of wren ai 0.7,

using open ai LLM provider using groq url and Key

for the mebedings i am using my local ollama installation (windows : the app not the docker container)

every thngs seeams to be OK, i can access the UI, bet when asking for somthing the UI says : Failed to create asking task.

and i have this error in the wren-ui console log

how to manage this a try my fisrt working experience

@Namec999 Namec999 added the bug Something isn't working label Jul 6, 2024
@cyyeh
Copy link
Member

cyyeh commented Jul 6, 2024

@Namec999

Hi, thanks for reaching out!

Please provide container logs to us by entering these commands in the shell(These commands will save the container logs to your current working directory in the shell)

docker logs wrenai-wren-ui-1 >& wrenai-wren-ui.log && \
docker logs wrenai-wren-ai-service-1 >& wrenai-wren-ai-service.log && \
docker logs wrenai-wren-engine-1 >& wrenai-wren-engine.log && \
docker logs wrenai-ibis-server-1 >& wrenai-ibis-server.log

@cyyeh
Copy link
Member

cyyeh commented Jul 6, 2024

Please also provide the .env.ai file with credential key removed.

@Namec999
Copy link
Author

Namec999 commented Jul 7, 2024

all the requested files are bellow :

.env.ai.txt
.env.txt
wrenai-ibis-server.log
wrenai-wren-ai-service.log
wrenai-wren-engine.log
wrenai-wren-ui.log

@cyyeh
Copy link
Member

cyyeh commented Jul 8, 2024

@Namec999 I think the EMBEDDING_MODEL_DIMENSION of your chosen embedding model nomic-emded-text should be 768 instead of 8192. Reference: https://huggingface.co/nomic-ai/nomic-embed-text-v1.5

Could you change that and restart launcher and try again?

@cyyeh cyyeh added the module/ai-service ai-service related label Jul 8, 2024
@Namec999
Copy link
Author

Namec999 commented Jul 8, 2024

even when setting the dimension to 768, still have the same issue, with same errors

@cyyeh
Copy link
Member

cyyeh commented Jul 8, 2024

@Namec999 could you elaborate what does this sentence mean?

for the mebedings i am using my local ollama installation (windows : the app not the docker container)

Also I suppose you don't need to change the EMBEDDER_OLLAMA_URL, the default should be fine. Also, did you pull the embedding model from Ollama already by running ollama pull nomic-emded-text first?

@Namec999
Copy link
Author

Namec999 commented Jul 8, 2024

yep, my ollama is well installed, and can reach the ollama api locally using postman et get my embeddings

@cyyeh
Copy link
Member

cyyeh commented Jul 8, 2024

Since Wren AI is running in docker containers, so using 192.168.x.x may not successfully access Ollama

@cyyeh
Copy link
Member

cyyeh commented Jul 8, 2024

The default url doesn't mean Ollama is running in Docker. It helps Wren AI running in Docker successfully resolve URL to access Ollama in your local machine

@Namec999
Copy link
Author

Namec999 commented Jul 8, 2024

currently using my ollama sincs months with other tools like Dify, and works OK

also replaced the 192.168... url with the default one mentioned in the env file

@cyyeh
Copy link
Member

cyyeh commented Jul 8, 2024

@Namec999 or do you mind join our discord server and we book a time for a quick chat, so I can help you look at your issue? There must be something wrong out there that I missed out.

https://discord.gg/5DvshJqG8Z

@cyyeh
Copy link
Member

cyyeh commented Jul 9, 2024

@Namec999 I've found the issue, now there is a bug in wren-ai-service. There are now two work-around solutions for you.

  1. Reset the project and start over again every time you restart wren-ai-service
  2. Modify the model and redeploy manually

We'll fix this in the next release. Sorry for your inconvenience.

@Namec999
Copy link
Author

Namec999 commented Jul 9, 2024

greate news :-)

thank you for your support

@cyyeh
Copy link
Member

cyyeh commented Jul 10, 2024

@Namec999 We've released a new version, please try again!

https://github.com/Canner/WrenAI/releases/tag/0.7.1

@Namec999
Copy link
Author

Hey, Greate News,

actuualy when trying the link you provided for the windows version (.zip), my system says that it contains a the Trojan:Script/Wacatac.H!ml virus !!!!

but when downloading the file from the Docs, it's OK, but i cannot see if it's the latest version or not.

best

@Namec999
Copy link
Author

tried downloading the 0.7.1-rc.1

but the wrenai-wren-ai-service-1 container keeps restarting :

with this console log :

INFO: Application startup complete.
INFO: Uvicorn running on https://0.0.0.0:5555 (Press CTRL+C to quit)
Traceback (most recent call last):
File "//src/force_deploy.py", line 7, in
from src.utils import load_env_vars
ModuleNotFoundError: No module named 'src'
INFO: Started server process [7]
INFO: Waiting for application startup.

@cyyeh
Copy link
Member

cyyeh commented Jul 10, 2024

@Namec999 the link I gave you is the latest version(0.7.1), 0.7.1-rc.1 is not.

@cyyeh
Copy link
Member

cyyeh commented Jul 10, 2024

Hey, Greate News,

actuualy when trying the link you provided for the windows version (.zip), my system says that it contains a the Trojan:Script/Wacatac.H!ml virus !!!!

but when downloading the file from the Docs, it's OK, but i cannot see if it's the latest version or not.

best

yeah, the file downloaded from the docs should also be the latest verion(0.7.1)

@cyyeh
Copy link
Member

cyyeh commented Jul 17, 2024

@Namec999 could I close this issue?

@Namec999
Copy link
Author

of course yes

:-) thank you for your support

you are really achieving greatness

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working module/ai-service ai-service related
Projects
None yet
Development

No branches or pull requests

2 participants