Skip to content

Issues: openai/evals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
85 Open 118 Closed
85 Open 118 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

I wanna GPT4's API
#349 by Kiyliy was closed Mar 20, 2023
8
Mistakes
#249 by Maximkrupchatnikov was closed Mar 20, 2023
1
On the aggregation of the evaluation
#256 by PierreColombo was closed Mar 20, 2023
1
-e in pip install -e . fails (linux and wsl2) [Solved: Update pip]
#269 by mmtmn was closed Mar 18, 2023
6
风险评估
#282 by Qihaibiao was closed Mar 20, 2023
6
Error updating the Git index
#284 by DCGoD was closed Mar 28, 2023
2
Enhancing evaluation pull requests with example questions
#287 by mrconter1 was closed Apr 13, 2023
1
--no-cache not functional
#305 by aaronsmithtv was closed Mar 21, 2023
3
ARC challenge Idea for Eval These issues keep track of requests for different kinds of eval PRs
#2 by bhack was closed Dec 5, 2023
10
Can understant the output results
#326 by lshowway was closed Mar 28, 2023
1
CI issue: openai.error.AuthenticationError: Invalid authorization header
#328 by Ein-Tim was closed Mar 18, 2023
1
API for evals
#335 by faradeen-ja was closed Mar 20, 2023
TypeError
#348 by rarhs was closed Mar 20, 2023
1
argparse.BooleanOptionalAction is not available in Python 3.8
#51 by hh-19 was closed Mar 28, 2023
1
Re-run PR checks for eval submissions affected by CI issue
#353 by mkirch was closed Mar 20, 2023
2
article not found
#354 by yuceismail was closed Mar 20, 2023
3
Create an issue for implementing chatgpt-4 directly in CMD / Powershell / Bash
#371 by victorhugoalmeid was closed Aug 10, 2023
1
assert ( AssertionError: Eval match_mmlu_anatomy not found. Available: ['coqa-closedqa',
#378 by 123456xxn was closed Mar 28, 2023
3
Sincere advice of deadline@Openai Team Members
#323 by neolizhe was closed Mar 20, 2023
3
Error when install evals with pyarrow
#13 by fish2022Jul was closed Apr 13, 2023
8
Pre-commit conflicts
#18 by ehgp was closed Mar 14, 2023
chore: Found an unnecessary reference to the declaration
#25 by soulteary was closed Mar 28, 2023
1
FileNotFoundError
#29 by NuclearGeekETH was closed Mar 20, 2023
5
Spanish docs
#34 by slf188 was closed Mar 15, 2023
3
Support for or examples of Evals with image prompts?
#50 by kfarr was closed Mar 14, 2023
2
ProTip! Adding no:label will show everything without a label.