Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to configure "Terminal Chat" on second machine results in invalid Azure OpenAI endpoint error. #16442

Open
Tracked by #15000
akulbe opened this issue Dec 8, 2023 · 4 comments
Assignees
Labels
Area-Chat All things LLM or "AI" Issue-Bug It either shouldn't be doing this or needs an investigation. Needs-Tag-Fix Doesn't match tag requirements Product-Terminal The new Windows Terminal.
Milestone

Comments

@akulbe
Copy link

akulbe commented Dec 8, 2023

Windows Terminal version

1.20.3401.0

Windows build number

22635.2841

Other Software

No response

Steps to reproduce

  1. I have "Terminal Chat" successfully configured on one machine already.
  2. Open up Terminal, go to Settings > Terminal Chat, add the endpoint URL and Key 2.
  3. Save Settings and close Terminal.
  4. Reopen Terminal and go to Terminal Chat.
  5. Attempt to enter prompt.
  6. Be greeted with a message saying the endpoint I provided is not a valid Azure OpenAI endpoint.

image
image

Expected Behavior

image

I was expecting similar results as this screenshot shows, where the Terminal is actually connecting to, and interacting with, the LLM.

Actual Behavior

Received the "Not a valid endpoint" error message

@akulbe akulbe added Issue-Bug It either shouldn't be doing this or needs an investigation. Needs-Triage It's a new issue that the core contributor team needs to triage at the next triage meeting labels Dec 8, 2023
@zadjii-msft zadjii-msft added the Area-Chat All things LLM or "AI" label Dec 11, 2023
@carlos-zamora carlos-zamora added this to the Backlog milestone Dec 13, 2023
@carlos-zamora carlos-zamora added Product-Terminal The new Windows Terminal. and removed Needs-Triage It's a new issue that the core contributor team needs to triage at the next triage meeting labels Dec 13, 2023
@microsoft-github-policy-service microsoft-github-policy-service bot added the Needs-Tag-Fix Doesn't match tag requirements label Dec 13, 2023
@g0t4
Copy link

g0t4 commented Jun 15, 2024

I can't configure Terminal Chat to work either, I get a different warning Resource not found and I have verified the endpoint works when I make a curl call... one concern I have is, what is the deployment name supposed to be? The docs don't list a name to use and forming an API request requires a deployment name (unless it does some model lookup and uses first matching model?)... the docs show TerminalSuggestions model deployment name but that doesn't work either. I am using canary 1.22.1661.0

@g0t4
Copy link

g0t4 commented Jun 15, 2024

@akulbe FYI my Azure OpenAI service endpoint now uses .openai.azure.com and not .cognitiveservices.azure.com so maybe check your Azure portal for a new endpoint?

@PankajBhojwani
Copy link
Contributor

Make sure you are using the correct endpoint! The one in your screenshot is not the endpoint for your deployment, you need to go into your deployment's "playground" in azure ai studio and then click "view code" to find the correct one:

Image

@PankajBhojwani
Copy link
Contributor

Agreed that it is quite difficult to find the correct endpoint unfortunately, even in my screenshot the correct endpoint is not the one in the textbox, it is the one in the curl command (the one that is blanked out but pointed to with the red arrow)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area-Chat All things LLM or "AI" Issue-Bug It either shouldn't be doing this or needs an investigation. Needs-Tag-Fix Doesn't match tag requirements Product-Terminal The new Windows Terminal.
Projects
None yet
Development

No branches or pull requests

5 participants