-
Notifications
You must be signed in to change notification settings - Fork 2.6k
Issues: openai/evals
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Information exposure alert through an exception
bug
Something isn't working
#1543
opened Aug 8, 2024 by
arpitjain099
Multiple Unit Test Failures Across OpenAI Assistants, Anthropic, and Google Gemini Libraries
bug
Something isn't working
#1536
opened Jun 24, 2024 by
sakher
Setting completion function args via CLI does not work
bug
Something isn't working
#1504
opened Mar 27, 2024 by
LoryPack
OpenAIChatCompletionFn
should __init__
should accept **kwargs
bug
#1493
opened Mar 15, 2024 by
ezraporter
Proposal for Adding a New Evaluation Metric: Sentiment Analysis Accuracy
#1419
opened Nov 23, 2023 by
Sarfaraz021
Using different models in evaluating mode-graded eval and in generating the completion
#1393
opened Nov 3, 2023 by
LoryPack
In the task "balance_chemical_equation", many instances have incorrect labels.
bug
Something isn't working
#1386
opened Oct 19, 2023 by
dongZheX
Eval-running often hangs on last sample
bug
Something isn't working
#1384
opened Oct 17, 2023 by
sjadler2004
Context window of completion functions not accounted for
bug
Something isn't working
#1377
opened Oct 13, 2023 by
pskl
How to eval output with ideal_answer directly without having to define the completion_fn ?
#1342
opened Aug 29, 2023 by
liuyaox
Having trouble building Evals locally? Try this.
bug
Something isn't working
#1340
opened Aug 25, 2023 by
silverfoxf7
Previous Next
ProTip!
Follow long discussions with comments:>50.