Skip to content

Pull requests: EleutherAI/lm-evaluation-harness

New pull request New
Clear current search query, filters, and sorts
16 Open 15 Closed
16 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

HF: switch conditional checks to self.backend from AUTO_MODEL_CLASS
#2353 opened Sep 25, 2024 by baberabb Loading…
7
Add KoCommonGEN v2 benchmark
#2208 opened Aug 12, 2024 by metterian Loading…
8
Logging
#2203 opened Aug 9, 2024 by lintangsutawika Loading…
@haileyschoelkopf
5
Add new benchmark: Basque bench
#2153 opened Jul 30, 2024 by zxcvuser Loading…
7
Introduce perplexity per token in loglikelihood_rolling
#2132 opened Jul 23, 2024 by dtamayo-nlp Loading…
1
6
Chat template fix
#2058 opened Jul 2, 2024 by NathanHB Loading…
2
14
swahili_ARC_Challenge
#2031 opened Jun 27, 2024 by msamwelmollel Loading…
6
[add] multiple-choice-question versions of fld benchmark
#2022 opened Jun 26, 2024 by MorishT Loading…
3
Add Redlite tasks for safety benchmarking
#2020 opened Jun 25, 2024 by inno-simon Loading…
11
add persianmmlu benchmark for assessing Persian Language understanding
#1979 opened Jun 17, 2024 by MrzEsma Loading…
3
Addition of BedrockChatModel
#1708 opened Apr 16, 2024 by jacquelinegarrahan Loading…
@haileyschoelkopf
6
Klokan-qa task
#1657 opened Apr 1, 2024 by hynky1999 Loading…
10
Physics GRE task added
#1655 opened Apr 1, 2024 by ShayekhBinIslam Loading…
1
10
Adding new task: Boxes
#1557 opened Mar 11, 2024 by irafayabdul Loading…
8
add all vlsp
#1123 opened Dec 14, 2023 by qnguyen3 • Draft
15
[API] Use private HF token for HF models and hide it when print to json file or console
#968 opened Nov 6, 2023 by vvchernov Loading…
@haileyschoelkopf
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.