What's Changed

• Fix typo in BigGenBench/requirements.txt by @MattYoon in #41
• Bump litellm from 1.40.7 to 1.40.16 in /libs/prometheus-eval by @dependabot in #45
• Release 0.1.18 by @scottsuk0306 in #49

New Contributors

• @MattYoon made their first contribution in #41
• @dependabot made their first contribution in #45

Full Changelog: v0.1.17...v0.1.18

What's Changed

• Fix relative grade by @scottsuk0306 in #40

Full Changelog: v0.1.16...v0.1.17

What's Changed

• Litellm bugfix by @ilyalasy in #38

New Contributors

• @ilyalasy made their first contribution in #38

Full Changelog: v0.1.15...v0.1.16

What's Changed

• Fix the Huggingface example in README.md by @scottsuk0306 in #21
• Add columns_to_keep to fix dataset loading issue by @noiji in #31
• New Feature: Support BiGGen-Bench Evaluation by @scottsuk0306 in #33

New Contributors

• @noiji made their first contribution in #31

Full Changelog: v0.1.13...v0.1.15

What's Changed

• Initialize lib by @scottsuk0306 in #1
• Update progress by @scottsuk0306 in #2
• Feat/package tests by @scottsuk0306 in #3
• Update train and eval folder by @scottsuk0306 in #4
• Feat/docs by @scottsuk0306 in #5
• Update README.md by @eltociear in #7
• Feat/docs by @scottsuk0306 in #8
• Feat/docs by @scottsuk0306 in #10
• Feat/update docs by @scottsuk0306 in #12
• Fix by @scottsuk0306 in #13
• Feat/update docs by @scottsuk0306 in #14
• Fix RELATIVE_PROMPT and RELATIVE_PROMPT_WO_REF by @alvarobartt in #18
• Add documentation by @scottsuk0306 in #19
• Fix/prompts newline by @scottsuk0306 in #20

New Contributors

• @scottsuk0306 made their first contribution in #1
• @eltociear made their first contribution in #7
• @alvarobartt made their first contribution in #18

Full Changelog: https://github.com/prometheus-eval/prometheus-eval/commits/v0.1.13