-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PromptNode
doesn't support isolated node evaluation
#3275
Labels
P2
Medium priority, add to the next sprint if no P1 available
topic:pipeline
type:bug
Something isn't working
Comments
PromptNode
doesn't support isolated node evaluation
#5291 adds support for isolated node evaluation in Given that we removed |
Closing as won't fix |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
P2
Medium priority, add to the next sprint if no P1 available
topic:pipeline
type:bug
Something isn't working
Describe the bug
When running pipeline.eval_batch with a GenerativeQAPipeline the isolated node eval options seems to be ignored.
Additional context
To Reproduce
please take eval labels from the eval tutorial
The text was updated successfully, but these errors were encountered: