Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark hyde using evaluation harness #7826

Open
mrm1001 opened this issue Jun 7, 2024 · 0 comments
Open

Benchmark hyde using evaluation harness #7826

mrm1001 opened this issue Jun 7, 2024 · 0 comments
Assignees
Labels
P1 High priority, add to the next sprint topic:eval

Comments

@mrm1001
Copy link
Member

mrm1001 commented Jun 7, 2024

Context

In the past, we have written a successful Hyde blog post, but it did not have any performance metrics. We are aiming to create one blog post by the end of the quarter to showcase the evaluation harness used for advanced techniques. This work will lay the ground-work for that blog post.

Task description

Add another architecture to the evaluation repository, where we show how to improve the performance of a naive RAG pipeline using the evaluation harness and a Hyde architecture.

@mrm1001 mrm1001 added the P1 High priority, add to the next sprint label Jun 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P1 High priority, add to the next sprint topic:eval
Projects
None yet
Development

No branches or pull requests

3 participants