Empty response with custom api

[thanhnew2001]

I built and install a custom API at https://7b80-103-253-89-37.ngrok-free.app/api/generate

Everything works fine.

But when change the endpoint and config template in LLM VSC into this endpoint. Everything just response nothing.

There is no clue to debug. Please help me.

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[r5r3]

I have a similar problem. I'm running Phind/Phind-CodeLlama-34B-v2 locally with TGI. When I trigger the suggestion, I see that a request is send to TGI, and that the response contains the expected [{'generated_text': '..... However, in almost all cases, the suggestion is not shown.

How is the decision made, if a suggestion is shown or not? If it possible to influence the decision?

[github-actions]

This issue is stale because it has been open for 30 days with no activity.