Commits

Commits on Jan 3, 2024

Add gpt-3.5-turbo-16k support to ctx len getter (openai#1388 )

danesherbs
and
ianmckenzie-oai
committedJan 3, 2024
Fixed parameter incorrect (openai#1378 )
assert6
committedJan 3, 2024

Commits on Dec 24, 2023

Randomly select MMMU answer when none is returned from the model (openai#1447 )
etr2460
committedDec 24, 2023

Commits on Dec 21, 2023

Change wrong kwargs name (openai#1435 )
Lorenzo Pacchiardi
committedDec 21, 2023
Fix Pydantic warning on data_test run (openai#1445 )
inwaves
committedDec 21, 2023
Fix small typo in oaieval run function (openai#1438 )
inwaves
committedDec 21, 2023
Release 2.0.0 (openai#1444 )
etr2460
committedDec 21, 2023
Add MMMU evals and runner (openai#1442 )
etr2460
committedDec 21, 2023
Use the API key for testing evals in CI (openai#1443 )
etr2460
committedDec 21, 2023

Commits on Dec 20, 2023

Commits on Dec 15, 2023

Ballots v2 (openai#1390 )

james-aung
and
ojaffe
committedDec 15, 2023
Schelling Point v2 (openai#1391 )

james-aung
and
ojaffe
committedDec 15, 2023

Commits on Dec 11, 2023

Fix bluff for openai >= 1.0.0 and unbreak tests (openai#1427 )
etr2460
committedDec 11, 2023
Update CODEOWNERS to new maintainers (openai#1431 )
etr2460
committedDec 11, 2023
Update README.md (openai#1429 )
logankilpatrick
committedDec 11, 2023

Commits on Dec 10, 2023

docs: documentation out of date/sync with inlined example code. (openai#1417 )
tregoning
committedDec 10, 2023
Docs typos (openai#1415 )
krychu
committedDec 10, 2023

Commits on Dec 8, 2023

[ci] Fix referencing API key for unit tests (openai#1425 )
etr2460
committedDec 8, 2023

Commits on Dec 5, 2023

Fix commandline --help exception (openai#1381 )
skyan
committedDec 5, 2023
Upgrade openai to >=1.0.0 (openai#1420 )
etr2460
committedDec 5, 2023

Commits on Nov 15, 2023

Sandbagging readme (openai#1412 )
ojaffe
committedNov 15, 2023
Amend contribution statements for Bluff and ToM from PolRes team (openai#1413 )
james-aung
committedNov 15, 2023
Bluff eval (openai#1402 )
johny-b
committedNov 15, 2023
Fix the OpenAI Version to <=0.28.1 (openai#1410 )
andrew-openai
committedNov 15, 2023
Sandbagging eval (openai#1409 )
ojaffe
committedNov 15, 2023
MMP v2 eval (openai#1403 )
ojaffe
committedNov 15, 2023
Add theory of mind eval (openai#1405 )
inwaves
committedNov 15, 2023
Self-Prompting eval (openai#1401 )
JunShern
committedNov 15, 2023
Revert "[Evals] Update the errors we except for retries (openai#1406 )"
andrew-openai
committedNov 15, 2023

Commits on Nov 13, 2023

[Evals] Update the errors we except for retries (openai#1406 )
andrew-openai
committedNov 13, 2023

Commits on Nov 9, 2023

Add new Solvers framework (openai#1397 )
JunShern
committedNov 9, 2023

Commits on Oct 27, 2023

Added Icelandic inflection eval; JsonMatch eval function (openai#1387 )
vthorsteinsson
committedOct 27, 2023