You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have a task that requires context for requests. This leads to changes in evaluator as long as while processing the requests I do not have access to the answers to update the new requests so that they include "the context" - the questions and model answers for the previous ones. Now I want to use the designed evaluator instead of the original one only for this task. Is it possible to somehow overwrite the evaluator through yaml file of the task? Some kind of function that substitutes the original evaluator with my own so that I still can use the original one for other tasks (each task is launched separetely)?
The text was updated successfully, but these errors were encountered:
I have a task that requires context for requests. This leads to changes in evaluator as long as while processing the requests I do not have access to the answers to update the new requests so that they include "the context" - the questions and model answers for the previous ones. Now I want to use the designed evaluator instead of the original one only for this task. Is it possible to somehow overwrite the evaluator through yaml file of the task? Some kind of function that substitutes the original evaluator with my own so that I still can use the original one for other tasks (each task is launched separetely)?
The text was updated successfully, but these errors were encountered: