Add fine tuning tests #44695

ralph-msft · 2024-06-21T21:24:51Z

Fixes some issues with the FineTuningClient and FileClient that were preventing fine tuning scenarios from working
- Wrong paths were being used in the generated REST requests
- Multi-part uploads were not setting the required Content-Type header correctly for each the file part
- File uploads for fine tuning return HTTP 201 which was treated as an error before
Adds more thorough fine tuning model tests, as well as all the required types and clients to be able exercise all parts of the fine tuning model scenario

- Fixes JSON issues due to moving to older JSON version - Fixes vector store test that was subject to race condition in status

…and cleanup - Fixed a bug where the path being used for jobs requests was incorrect (missing /jobs/) - Fixed abug where the job checkpoints was not generating correct requests - Added some internal only extension methods for FineTuningClient that allow you to delete a job in Azure OpenAI. This differs from how OpenAI works and this seemed liked the easiest way for now allowing testing and a suggestion for a future implementation - Added some test only models to make working with fine tuning clients easier - Added more thorough fine tuning testing including some very long running ones

NOTE: This only fixes the issue for Azure OpenAI. A proper fix will require updates to the autogenerated code which will in a later PR

…for_older_json

…ne_tuning_tests

…g_tests

azure-sdk · 2024-06-21T21:41:03Z

API change check

API changes are not detected in this pull request.

sdk/openai/Azure.AI.OpenAI/src/Custom/AzureOpenAIClient.cs

sdk/openai/Azure.AI.OpenAI/src/Custom/Files/AzureFileClient.cs

sdk/openai/Azure.AI.OpenAI/src/Custom/FineTuning/AzureFineTuningClient.Extensions.cs

sdk/openai/Azure.AI.OpenAI/src/Properties/AssemblyInfo.cs

…g_tests

- Fixes some issues with the FineTuningClient and FileClient that were preventing fine tuning scenarios from working - Wrong paths were being used in the generated REST requests - Multi-part uploads were not setting the required Content-Type header correctly for each the file part - File uploads for fine tuning return HTTP 201 which was treated as an error before - Adds more thorough fine tuning model tests, as well as all the required types and clients to be able exercise all parts of the fine tuning model scenario

ralph-msft added 12 commits June 7, 2024 13:58

Fix double ? issues with generated URIs

30e5480

Test fixes

50825f5

- Fixes JSON issues due to moving to older JSON version - Fixes vector store test that was subject to race condition in status

Bug fixes and tweaks

2f23a51

Move fix for .Net Framework 4.6.2 double ? up a level.

64e6582

NOTE: This only fixes the issue for Azure OpenAI. A proper fix will require updates to the autogenerated code which will in a later PR

Merge remote-tracking branch 'origin/main' into user/ralphe/polyfill_…

141f4a7

…for_older_json

Merge with changes in main

80a6a22

Merge remote-tracking branch 'origin/main' into user/ralphe/polyfill_…

c8107ee

…for_older_json

Merge branch 'user/ralphe/polyfill_for_older_json' into ralphe/add_fi…

c0e554f

…ne_tuning_tests

Improve unix date time converter

9768e5b

Merge remote-tracking branch 'origin/main' into ralphe/add_fine_tunin…

cb5853c

…g_tests

Cleanups & reduce delta

2791adf

ralph-msft requested review from jpalvarezl, trrwilson, joseharriaga and m-nash as code owners June 21, 2024 21:24

github-actions bot added the OpenAI label Jun 21, 2024

ralph-msft enabled auto-merge (squash) June 21, 2024 21:25