You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
To calculate the cost of the evaluation, we need a token count. Most generator components in Haystack provide that information in the meta field.
Describe the solution you'd like
LLM-based evaluators should return token count information with the result. This would be handy for connecting evaluation pipelines to monitoring tools such as Langfuse
Describe alternatives you've considered
Leave it as it is
Additional context
N/A
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
To calculate the cost of the evaluation, we need a token count. Most generator components in Haystack provide that information in the
meta
field.Describe the solution you'd like
LLM-based evaluators should return token count information with the result. This would be handy for connecting evaluation pipelines to monitoring tools such as Langfuse
Describe alternatives you've considered
Leave it as it is
Additional context
N/A
The text was updated successfully, but these errors were encountered: