Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval tests #204

Merged
merged 19 commits into from
Apr 25, 2023
Merged

Eval tests #204

merged 19 commits into from
Apr 25, 2023

Commits on Apr 20, 2023

  1. draft eval smoke tests

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    7c2a5e4 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    3947bba View commit details
    Browse the repository at this point in the history

  3. rm extraneous utils

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    3f64a6e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'eval_tests' of github.com:EleutherAI/elk into eval_tests

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    59ca19e View commit details
    Browse the repository at this point in the history

  5. simplify eig smoke test

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    7287757 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into eval_tests

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    53088cc View commit details
    Browse the repository at this point in the history

  7. fix prompt update bug, failing tests

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    7ba78f1 View commit details
    Browse the repository at this point in the history

  8. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    453370f View commit details
    Browse the repository at this point in the history

  9. split eval_run into act and assert

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    2fb36c6 View commit details
    Browse the repository at this point in the history

  10. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    d4eb57e View commit details
    Browse the repository at this point in the history

  11. prompt loading return

    @ChristyKoh
    ChristyKoh committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    396753c View commit details
    Browse the repository at this point in the history

  12. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    f8fb574 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. Repush commits under [email protected]

    @thejaminator
    thejaminator committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    e291ab4 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into eval_tests 

    # Conflicts:
#	elk/evaluation/evaluate.py
#	elk/extraction/extraction.py
#	elk/run.py
#	elk/training/train.py
#	elk/utils/__init__.py
    @thejaminator
    thejaminator committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    431fefc View commit details
    Browse the repository at this point in the history

  3. fix the dataset name

    @thejaminator
    thejaminator committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    5b6c828 View commit details
    Browse the repository at this point in the history

  4. fix other datasetdict functions

    @thejaminator
    thejaminator committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    408b8d3 View commit details
    Browse the repository at this point in the history

  5. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    68f41be View commit details
    Browse the repository at this point in the history

  6. remove unused class

    @thejaminator
    thejaminator committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    73640a5 View commit details
    Browse the repository at this point in the history

  7. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    625d9e8 View commit details
    Browse the repository at this point in the history