You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should check on all tasks to ensure that they do not use stop sequences that might cut off valid answers too early, such as happened with DROP. We've already done so for some tasks such as GSM8k as of the new release, but should look at other generation-based tasks.
A notable culprit is using \n as a stop sequence when \n\n would be more correct.
The text was updated successfully, but these errors were encountered:
We should check on all tasks to ensure that they do not use stop sequences that might cut off valid answers too early, such as happened with DROP. We've already done so for some tasks such as GSM8k as of the new release, but should look at other generation-based tasks.
A notable culprit is using
\n
as a stop sequence when\n\n
would be more correct.The text was updated successfully, but these errors were encountered: