Skip to content

Issues: openai/evals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
84 Open 117 Closed
84 Open 117 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Integrations
#442 by jimmywilk was closed Mar 28, 2023
1 🚀 1
Other Support
#187 by chatbots was closed Mar 20, 2023
2
Pre-commit conflicts
#18 by ehgp was closed Mar 14, 2023
chore: Found an unnecessary reference to the declaration
#25 by soulteary was closed Mar 28, 2023
1
FileNotFoundError
#29 by NuclearGeekETH was closed Mar 20, 2023
5
Spanish docs
#34 by slf188 was closed Mar 15, 2023
3
Support for or examples of Evals with image prompts?
#50 by kfarr was closed Mar 14, 2023
2
argparse.BooleanOptionalAction is not available in Python 3.8
#51 by hh-19 was closed Mar 28, 2023
1
📌 Contributing to Project Documentation on Readthedocs??
#52 by TarikKaanKoc was closed Mar 15, 2023
1
Brazilian docs
#54 by thyarles was closed Mar 15, 2023
1
Evaluating LLMs on QA Tasks
#65 by slavakurilyak was closed Mar 30, 2023
7
Building an MMLU Eval issue bug Something isn't working
#155 by ToadTWP666 was closed Dec 5, 2023
4
small bug in sample logic eval
#164 by DustinWehr was closed Mar 30, 2023
1
3
ARC challenge Idea for Eval These issues keep track of requests for different kinds of eval PRs
#2 by bhack was closed Dec 5, 2023
10
Making the code platform-agnostic would lead to more contributions
#209 by jonathanagustin was closed Mar 20, 2023
7
make it smarter
#217 by datboimiles23 was closed Mar 20, 2023
7
Problem using oaieval.py
#218 by JimmyfaQwQ was closed Mar 16, 2023
6
Cross-lingual pretraining abilities
#226 by Tshering-Penjor was closed Mar 28, 2023
2
Problem of oaieval.py
#243 by JimmyfaQwQ was closed Mar 17, 2023
3
Solved! Bulk downloading chatgpt history.
#247 by irthomasthomas was closed Mar 20, 2023
8
TensorFlow fails while no TensorFlow expected to run at all bug Something isn't working
#1532 by artkpv was closed May 25, 2024
1
On the aggregation of the evaluation
#256 by PierreColombo was closed Mar 20, 2023
1
-e in pip install -e . fails (linux and wsl2) [Solved: Update pip]
#269 by mmtmn was closed Mar 18, 2023
6
风险评估
#282 by Qihaibiao was closed Mar 20, 2023
6
MYIDM
#185 by myidmrocks was closed Mar 20, 2023
1
ProTip! Exclude everything labeled bug with -label:bug.