-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Docs] Check if ChatGPT api on azure needs docs updates #4694
Comments
Check with Bogdan if the PromptNode doc https://docs.haystack.deepset.ai/docs/prompt_node#models needs updates because of the new invocation layer. |
I think the only thing that'll need to be updated is the fact that Azure call their model |
Sorry, sorry sorry... also you need to make sure the API version is either not set (as the integration will set it correctly), or set to In fact, you don't even need to set the API version in the base Azure OpenAI request either, because it's set by default in the following: https://github.com/deepset-ai/haystack/blob/main/haystack/nodes/prompt/invocation_layer/azure_open_ai.py#L20 Worth just removing the prompt_azure_open_ai = PromptModel(
model_name_or_path="text-davinci-003",
api_key="<your-azure-openai-key>",
model_kwargs={
"api_version": "2022-12-01",
"azure_base_url":"https://<your-endpoint>.openai.azure.com",
"azure_deployment_name": "<your-deployment-name>",
}
) |
No description provided.
The text was updated successfully, but these errors were encountered: