Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval tests #204

Merged
merged 19 commits into from
Apr 25, 2023
Merged

Eval tests #204

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
7c2a5e4
draft eval smoke tests
ChristyKoh Apr 20, 2023
3947bba
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 20, 2023
3f64a6e
rm extraneous utils
ChristyKoh Apr 20, 2023
59ca19e
Merge branch 'eval_tests' of github.com:EleutherAI/elk into eval_tests
ChristyKoh Apr 20, 2023
7287757
simplify eig smoke test
ChristyKoh Apr 20, 2023
53088cc
Merge branch 'main' into eval_tests
ChristyKoh Apr 20, 2023
7ba78f1
fix prompt update bug, failing tests
ChristyKoh Apr 20, 2023
453370f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 20, 2023
2fb36c6
split eval_run into act and assert
ChristyKoh Apr 20, 2023
d4eb57e
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 20, 2023
396753c
prompt loading return
ChristyKoh Apr 20, 2023
f8fb574
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 20, 2023
e291ab4
Repush commits under [email protected]
thejaminator Apr 25, 2023
431fefc
Merge remote-tracking branch 'origin/main' into eval_tests
thejaminator Apr 25, 2023
5b6c828
fix the dataset name
thejaminator Apr 25, 2023
408b8d3
fix other datasetdict functions
thejaminator Apr 25, 2023
68f41be
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 25, 2023
73640a5
remove unused class
thejaminator Apr 25, 2023
625d9e8
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 25, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Prev Previous commit
Next Next commit
rm extraneous utils
  • Loading branch information
@ChristyKoh
ChristyKoh committed Apr 20, 2023
commit 3f64a6ea4327276c9130fbb2363ce1e6419727ee
2 changes: 0 additions & 2 deletions tests/test_smoke_eval.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,6 @@
from elk.training import CcsReporterConfig, EigenReporterConfig
from elk.training.train import Elicit

ChristyKoh marked this conversation as resolved.
Show resolved Hide resolved
from tests.utils import *

ELICIT_EXPECTED_FILES = [
"cfg.yaml",
"fingerprints.yaml",
Expand Down