Commits

Commits on Jan 29, 2024

Updates for Solvers (openai#1461 )

committedJan 29, 2024

Commits on Jan 26, 2024

Logged spec now includes overridden args (openai#1460 )
ojaffe
committedJan 26, 2024
Add run_id to final_report from LocalRecorder (openai#1452 )
ianmckenzie-oai
committedJan 26, 2024

Commits on Jan 10, 2024

Fix formatting/typing so pre-commit hooks pass (openai#1451 )
ianmckenzie-oai
committedJan 10, 2024
icelandic gec eval (openai#1400 )
svanhvitlilja
committedJan 10, 2024

Commits on Jan 9, 2024

Add eval yaml for Theory of Mind eval (openai#1453 )
ojaffe
committedJan 9, 2024

Commits on Jan 3, 2024

Improve MMMU performance with prompt engineering (openai#1450 )
etr2460
committedJan 3, 2024
Add eval japanese prime minister (openai#1422 )
return-nil
committedJan 3, 2024
Solve openai#1394 (openai#1395 )
Lorenzo Pacchiardi
committedJan 3, 2024
Add a recorder for function calls (openai#1389 )
danesherbs
committedJan 3, 2024
Add gpt-3.5-turbo-16k support to ctx len getter (openai#1388 )

danesherbs
and
ianmckenzie-oai
committedJan 3, 2024
Fixed parameter incorrect (openai#1378 )
assert6
committedJan 3, 2024

Commits on Dec 24, 2023

Randomly select MMMU answer when none is returned from the model (openai#1447 )
etr2460
committedDec 24, 2023

Commits on Dec 21, 2023

Change wrong kwargs name (openai#1435 )
Lorenzo Pacchiardi
committedDec 21, 2023
Fix Pydantic warning on data_test run (openai#1445 )
inwaves
committedDec 21, 2023
Fix small typo in oaieval run function (openai#1438 )
inwaves
committedDec 21, 2023
Release 2.0.0 (openai#1444 )
etr2460
committedDec 21, 2023
Add MMMU evals and runner (openai#1442 )
etr2460
committedDec 21, 2023
Use the API key for testing evals in CI (openai#1443 )
etr2460
committedDec 21, 2023

Commits on Dec 20, 2023

Commits on Dec 15, 2023

Ballots v2 (openai#1390 )

james-aung
and
ojaffe
committedDec 15, 2023
Schelling Point v2 (openai#1391 )

james-aung
and
ojaffe
committedDec 15, 2023

Commits on Dec 11, 2023

Fix bluff for openai >= 1.0.0 and unbreak tests (openai#1427 )
etr2460
committedDec 11, 2023
Update CODEOWNERS to new maintainers (openai#1431 )
etr2460
committedDec 11, 2023
Update README.md (openai#1429 )
logankilpatrick
committedDec 11, 2023

Commits on Dec 10, 2023

docs: documentation out of date/sync with inlined example code. (openai#1417 )
tregoning
committedDec 10, 2023
Docs typos (openai#1415 )
krychu
committedDec 10, 2023

Commits on Dec 8, 2023

[ci] Fix referencing API key for unit tests (openai#1425 )
etr2460
committedDec 8, 2023

Commits on Dec 5, 2023

Fix commandline --help exception (openai#1381 )
skyan
committedDec 5, 2023
Upgrade openai to >=1.0.0 (openai#1420 )
etr2460
committedDec 5, 2023

Commits on Nov 15, 2023

Sandbagging readme (openai#1412 )
ojaffe
committedNov 15, 2023
Amend contribution statements for Bluff and ToM from PolRes team (openai#1413 )
james-aung
committedNov 15, 2023