-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Double check all of the zero/few-shot formats #34
Labels
documentation
Improvements or additions to documentation.
Projects
Comments
pruksmhc
pushed a commit
to pruksmhc/lm-evaluation-harness
that referenced
this issue
May 10, 2022
Update from EAI
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Once we have everything implemented, we should double check that we actually have the same zero/few shot format as was used for GPT3. The paper is, as expected, terribly vague, so we should try contacting OA for more info. Making sure this is done correctly is critical before proceeding further.
The text was updated successfully, but these errors were encountered: