Skip to content

Issues: openai/evals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
0 Open 111 Closed
0 Open 111 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Ssomsak
#1538 by SsomsakTH was closed Jun 28, 2024
TensorFlow fails while no TensorFlow expected to run at all bug Something isn't working
#1532 by artkpv was closed May 25, 2024
1
Support for GPT-4o
#1529 by PrashantDixit0 was closed May 26, 2024
3
Getting started example doesn't work - oieval attempts to update a None type object bug Something isn't working
#1515 by jswang was closed Apr 5, 2024
1
1
When installing the project dependencies, i got: "ERROR: Could not build wheels for greenlet, which is required to install pyproject.toml-based projects" bug Something isn't working
#1513 by JuanmaMenendez was closed Apr 4, 2024
1
3
Local run doesn't save logs to disk bug Something isn't working
#1459 by charles-somm was closed Jan 16, 2024
1
Tagged Release For 2.0.0 bug Something isn't working
#1456 by michaelAlvarino was closed Jan 12, 2024
1
Possibility to sell high quality benchmarks
#1437 by guliashvili was closed May 7, 2024
1
Mismatch between LangChainChatModelCompletionFn code and registry bug Something isn't working
#1434 by LoryPack was closed Dec 21, 2023
1
3
Error structure in utils after openai package upgrade
#1432 by inwaves was closed Dec 20, 2023
2
oaieval doesn't run beacuse of "module 'openai' has no attribute 'error'" bug Something isn't working
#1426 by Antim8 was closed Dec 9, 2023
3
Running an evaluation can lead to circular import error bug Something isn't working
#1424 by chhabrakadabra was closed Dec 21, 2023
4
Do not back off on openai.BadRequestError
#1408 by johny-b was closed Dec 5, 2023
1
Evals broken with latest openai package v1.1.1 bug Something isn't working
#1399 by ojaffe was closed Nov 13, 2023
1
2
Failed to open: ../registry/data/social_iqa/few_shot.jsonl with custom registry bug Something isn't working
#1394 by LoryPack was closed Jan 3, 2024
1
oaieval --help errors for me bug Something isn't working
#1369 by sjadler2004 was closed Dec 5, 2023
@logankilpatrick
3
All evals currently in the repo appear only to have dev samples: is this correct?
#1319 by mesotron was closed Jul 21, 2023
1
Please approve pull request, changes were made.
#1298 by nickabooch was closed Jul 13, 2023
Unable to modify match_fn from within modelgraded eval .yaml file bug Something isn't working
#1284 by sohenze was closed Mar 9, 2024
Meaning of "elsuite" folder name
#1282 by siftxxx was closed Jul 5, 2023
2
gpt-4-32k
#1246 by OhadRubin was closed Dec 5, 2023
5
You should see GPT-4 API access enabled in your account in the next few days.
#1208 by verheesj was closed Jun 21, 2023
1
Evaluate gpt-4-0613 and gpt-3.5-turbo-0613 yields invalid_request_during_completion bug Something isn't working
#1175 by peldszus was closed Jun 16, 2023
3
Access not working
#1174 by Timeroot was closed Jun 16, 2023
2
Awaiting GPT-4 Access For Further Development
#1172 by grahamzemel was closed Jun 16, 2023
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.