Skip to content

Issues: EleutherAI/lm-evaluation-harness

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Duplicate sample entries
#2025 opened Jun 26, 2024 by baberabb updated Jun 26, 2024
Task assigned to only one group when multiple groups are run bug Something isn't working.
#1436 opened Feb 17, 2024 by baberabb updated Feb 19, 2024
Different fewshot with and w/o accelerate DDP
#1308 opened Jan 17, 2024 by baberabb updated Jan 28, 2024
Only a single filtered_resps is logged for repeat > 1 for each sample bug Something isn't working.
#1232 opened Jan 1, 2024 by baberabb updated Jan 8, 2024
ProTip! Mix and match filters to narrow down what you’re looking for.