-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Issues: EleutherAI/lm-evaluation-harness
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Implement the ASDiv Evaluation
feature request
A feature that isn't implemented yet.
#190
by leogao2
was closed Jan 4, 2022
Implement the APPS evaluation
feature request
A feature that isn't implemented yet.
#196
by leogao2
was closed Jan 15, 2023
Implement GLUE STSB
feature request
A feature that isn't implemented yet.
#93
by leogao2
was closed Feb 8, 2021
add meta tasks
feature request
A feature that isn't implemented yet.
#217
by leogao2
was closed Nov 21, 2022
Implement the QASPER evaluation
feature request
A feature that isn't implemented yet.
#184
by leogao2
was closed Feb 22, 2022
Implement something to deal with long contexts (and to help find the best k-shot)
#157
by leogao2
was closed Mar 9, 2023
Implement GPT3 greedy_until
feature request
A feature that isn't implemented yet.
#96
by leogao2
was closed Nov 21, 2022
Implement GPT2 greedy_until
feature request
A feature that isn't implemented yet.
#95
by leogao2
was closed Nov 21, 2022
Implement GPT3 logprobs for new framework
feature request
A feature that isn't implemented yet.
#94
by leogao2
was closed Nov 21, 2022
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.