Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prometheus 2 notebook #92

Merged
merged 6 commits into from
Jun 14, 2024
Merged

Prometheus 2 notebook #92

merged 6 commits into from
Jun 14, 2024

Conversation

anakin87
Copy link
Member

@anakin87 anakin87 commented Jun 6, 2024

In this notebook, I'm experimenting with Prometheus 2 to evaluate RAG pipelines.

@TuanaCelik take a look and see how we could communicate this
@bilgeyucel (optional): take a look, see if it is understandable

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@@ -0,0 +1,12348 @@
{
Copy link
Member

@TuanaCelik TuanaCelik Jun 6, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two varients meaning fine-tuned from mistral-7b or mixtral?


Reply via ReviewNB

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes. Now I have clarified it a bit.

@TuanaCelik TuanaCelik self-requested a review June 10, 2024 08:05
@@ -0,0 +1,12347 @@
{
Copy link
Contributor

@davidsbatista davidsbatista Jun 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe this can be removed or commented and with a comment added that if the user ran the RAG pipeline no need for this step


Reply via ReviewNB

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense. I will clarify this point.

@@ -0,0 +1,12347 @@
{
Copy link
Contributor

@davidsbatista davidsbatista Jun 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: a newest release will already show the column metrics, and not that columns as the index in the dataframe


Reply via ReviewNB

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK for now let's leave it as is.

Copy link
Contributor

@davidsbatista davidsbatista left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just minor comments - good work Stefano 👍🏽

@anakin87 anakin87 merged commit 9f88afe into main Jun 14, 2024
@anakin87 anakin87 deleted the prometheus2 branch June 14, 2024 08:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants