Skip to content

Commit

Permalink
Merge pull request caikit#184 from gkumbhat/fix_eval_run_func
Browse files Browse the repository at this point in the history
🐛 Fix eval script for updated run datamodel
  • Loading branch information
gkumbhat committed Sep 12, 2023
2 parents ad2aca2 + d12369e commit 07ff722
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/evaluate_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ def get_model_preds_and_references(model, validation_stream):
for datum in tqdm(validation_stream):
# Local .run() currently prepends the input text to the generated string;
# Ensure that we're just splitting the first predicted token & beyond.
raw_model_text = model.run(datum.input).text
raw_model_text = model.run(datum.input).generated_text
parse_pred_text = raw_model_text.split(datum.input)[-1].strip()
model_preds.append(parse_pred_text)
targets.append(datum.output)
Expand Down

0 comments on commit 07ff722

Please sign in to comment.