2 Releases published by 1 person

• 1.13.0 Unitxt 1.13.0

  published Sep 25, 2024

• 1.13.1 Unitxt 1.13.1

  published Sep 30, 2024

20 Pull requests merged by 9 people

• Make F1Strings faster

  #1248 merged Sep 30, 2024

• Add huggingface cache disabling option to unitxt settings

  #1250 merged Sep 30, 2024

• CI for metrics other than main + Bugfix in RetrievalAtK

  #1246 merged Sep 30, 2024

• add post processor to convert log probs dictionary to probabilities of a specific class

  #1247 merged Sep 30, 2024

• Enhancements to inference engines

  #1243 merged Sep 30, 2024

• Update version to 1.13.1

  #1244 merged Sep 30, 2024

• Update README.md

  #1242 merged Sep 29, 2024

• Adding of ANLS metric to doc_vqa and info_vqa datasets

  #1241 merged Sep 29, 2024

• Deep copy artifacts that fetched twice

  #1239 merged Sep 29, 2024

• Allow templates dicts to be python dicts and fix a bug in the TemplatesDict definition

  #1240 merged Sep 29, 2024

• adding vllm remote inference engine

  #1236 merged Sep 26, 2024

• Add bluebench recipes

  #1237 merged Sep 26, 2024

• allow multiple references for f1 strings metric

  #1225 merged Sep 26, 2024

• Simplify qa example

  #1234 merged Sep 26, 2024

• Update version to 1.13.0

  #1232 merged Sep 25, 2024

• Add wml and generic based llmaj metric

  #1227 merged Sep 24, 2024

• Add concurency_limit parameter to WMLInferenceEngine

  #1231 merged Sep 24, 2024

• Fix table tasks to use default table serializers

  #1230 merged Sep 24, 2024

• Add control over serizliers from recipe + improve serializers construction + allow seed for table shuffling serizliers

  #1229 merged Sep 24, 2024

• A suggested PR for issue #1214: fixed a bug in score_prefix for grouped instance scores

  #1228 merged Sep 24, 2024

2 Pull requests opened by 2 people

• Added calls to prepare() to ensure requirement checks are done early

  #1233 opened Sep 25, 2024

• Fix duplicate column deletion bug in pandas serializer

  #1249 opened Sep 30, 2024

2 Issues closed by 2 people

• WMLInferenceEngine concurrency_limit

  #1215 closed Sep 24, 2024

• setting score_prefix for metric results in exception in group scores

  #1214 closed Sep 24, 2024

1 Issue opened by 1 person

• No documentation for inference engines

  #1235 opened Sep 25, 2024

3 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Integrate metrics team LLMaJ with current unitxt implemantation

  #1205 commented on Sep 30, 2024 • 9 new comments

• Using cached metrics in consecutive test_card runs can be faulty

  #884 commented on Sep 26, 2024 • 0 new comments

• Changing v11 instruction to test LLMAJ grounded ensemble

  #1218 commented on Sep 24, 2024 • 0 new comments