-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test the evaluation harness on RAG parameter tuning #7825
Labels
P1
High priority, add to the next sprint
Comments
The |
a working example with the Harness, showcasing a baseline RAG vs the HyDE technique is referenced here: and the full code here |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Context
The evaluation harness is going to be available for our users in the haystack-experimental package. In order for us to decide whether we want to keep this feature or not, and whether it needs any improvements, we would like to first test it internally before we collect feedback from our users.
Task description
Use the evaluation harness to optimise a RAG pipeline using parameter search.
Task outcome
The text was updated successfully, but these errors were encountered: