Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[New Task] Paloma Eval Suite #1176

Closed
haileyschoelkopf opened this issue Dec 20, 2023 · 0 comments · Fixed by #1928
Closed

[New Task] Paloma Eval Suite #1176

haileyschoelkopf opened this issue Dec 20, 2023 · 0 comments · Fixed by #1928
Assignees
@lintangsutawika
Labels
feature request A feature that isn't implemented yet. good first issue Good for newcomers help wanted Contributors and extra help welcome.

Comments

@haileyschoelkopf
Copy link
Contributor

https://arxiv.org/abs/2312.10523
@haileyschoelkopf haileyschoelkopf added help wanted Contributors and extra help welcome. feature request A feature that isn't implemented yet. good first issue Good for newcomers labels Dec 20, 2023
@lintangsutawika lintangsutawika self-assigned this Apr 9, 2024
@zafstojano zafstojano mentioned this issue Jun 5, 2024
Merged
@lintangsutawika lintangsutawika linked a pull request Jun 5, 2024 that will close this issue
[New Task] Add Paloma benchmark #1928
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lintangsutawika lintangsutawika

Labels
feature request A feature that isn't implemented yet. good first issue Good for newcomers help wanted Contributors and extra help welcome.
Projects
LM-Eval Support and Development
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[New Task] Add Paloma benchmark zafstojano/lm-evaluation-harness
2 participants
@lintangsutawika @haileyschoelkopf