Skip to content

Issues: EleutherAI/lm-evaluation-harness

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Results is weird for Qwen2-1.5B
#1944 by SefaZeng was closed Jun 24, 2024 updated Jun 24, 2024
ConnectionError: Couldn't reach 'truthful_qa' on the Hub (ProxyError)
#762 by SefaZeng was closed Aug 11, 2023 updated May 23, 2024
Error when evaluating math.
#1819 by SefaZeng was closed May 19, 2024 updated May 19, 2024
ProTip! Follow long discussions with comments:>50.