New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

humaneval task #1522

Closed

jordane95 opened this issue Mar 5, 2024 · 2 comments

Contributor

jordane95 commented Mar 5, 2024

Hi, I find that one important code generation task for evaluating llms is missing in the repo. Is there any plan on adding this task?

Contributor

LSinev commented Mar 5, 2024 •

edited

Loading

Please, take a look at or take part in the discussion #1157

Collaborator

haileyschoelkopf commented May 27, 2024

See #1157 for an update on this!

haileyschoelkopf closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment