Skip to content

Issues: openai/evals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

89 Open 118 Closed
89 Open 118 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Having trouble building Evals locally? Try this. bug Something isn't working
#1340 opened Aug 25, 2023 by silverfoxf7
1
Find claims from research paper
#1338 opened Aug 21, 2023 by ghost
Sample evaluations completing after timeout cause duplicate results bug Something isn't working
#1333 opened Aug 10, 2023 by robatwilliams
1
Accuracy Score
#1328 opened Aug 3, 2023 by jeyarajcs
oaieval hangs a lot bug Something isn't working
#1292 opened Jul 5, 2023 by shamas-
1
Code Evals
#1275 opened Jul 3, 2023 by billxbf
Expose run_id to code being run within an eval
#1264 opened Jun 29, 2023 by robatwilliams
2
国际化的支持
#1239 opened Jun 26, 2023 by wangkunmin
3
closedqa prompt is not adequate for gpt-4-0613
#1228 opened Jun 24, 2023 by JasonGross
1
Functions: Support for minItems and maxItems for json schema array
#1173 opened Jun 15, 2023 by tjhiggins
Any website where I can share evaluation results?
#1166 opened Jun 15, 2023 by pocca2048
7
stock picking as model eval
#1131 opened Jun 9, 2023 by qrdlgit
1
Extracting and analyzing data from scientific articles
#1126 opened Jun 8, 2023 by QuantumCoderr
Add version option to oaieval
#1102 opened Jun 5, 2023 by phelps-sg
pip package is outdated (1.0.3.post1) - has broken elsuite/basic/includes.py bug Something isn't working
#1098 opened Jun 4, 2023 by phelps-sg
Private local memory coordination
#1048 opened May 27, 2023 by rpsnoopy
Exact Match template
#1040 opened May 26, 2023 by JasonGross
1
[eval] Encrypt & Decrypt As An Engima Machine
#1022 opened May 24, 2023 by RohanRadia
4
Cannot pass the check and got this error: KeyError: 'sample' bug Something isn't working
#1012 opened May 23, 2023 by 14H034160212
1
oaieval fails with error UnicodeDecodeError: 'charmap' codec can't decode byte bug Something isn't working
#980 opened May 17, 2023 by rslinford
1
eval approach: GPT4 provides alternative responses with reasoning and then has to pick the best one
#968 opened May 14, 2023 by qrdlgit
1
Is there a list of tasks that chatgpt fails?
#952 opened May 10, 2023 by irthomasthomas
2
Remove leading whitespace from sampled answers in Match template
#947 opened May 9, 2023 by keltin13
Overall Report for Eval Set As a Whole
#939 opened May 8, 2023 by chinggg
docs out of date bug Something isn't working
#929 opened May 7, 2023 by rustam-e
ProTip! Type g i on any issue or pull request to go back to the issue listing page.