Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Blog post showcasing the data from the ARAGOG paper #7771

Closed
davidsbatista opened this issue May 30, 2024 · 1 comment
Closed

Blog post showcasing the data from the ARAGOG paper #7771

davidsbatista opened this issue May 30, 2024 · 1 comment
Assignees
@davidsbatista
Labels
P1 High priority, add to the next sprint topic:benchmark

Comments

@davidsbatista
Copy link
Contributor

davidsbatista commented May 30, 2024 •
edited
Loading

  • using the data from the ARAGOG paper
  • focus on the whole process:
    • origin, authorship and dataset creation process
    • loading the questions + dataset and any pre-processing
    • the indexing pipeline
    • the RAG pipeline
    • the evaluation pipeline
      • reference to the possible failures of the LLM-based evalutors and how we handled them
    • the insights gained, just some highlights, nothing into an academic discussions
  • goal: make the user understand how to use adapt the tutorial/code to his/her own usecase
@davidsbatista davidsbatista self-assigned this May 30, 2024
@mrm1001 mrm1001 added P1 High priority, add to the next sprint topic:benchmark labels May 30, 2024
@davidsbatista
Copy link
Contributor Author

Post published: https://haystack.deepset.ai/blog/benchmarking-haystack-pipelines

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davidsbatista davidsbatista

Labels
P1 High priority, add to the next sprint topic:benchmark
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mrm1001 @davidsbatista