Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi datasets #123

Merged
merged 46 commits into from
Mar 28, 2023
Merged

Multi datasets #123

merged 46 commits into from
Mar 28, 2023

Commits on Mar 9, 2023

  1. add multiple datasets support

    @Benw8888
    Benw8888 committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    681698d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:EleutherAI/elk into multi-datasets

    @Benw8888
    Benw8888 committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    ac1b9f1 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2023

  1. train_reporter works on a list of layers now

    @Benw8888
    Benw8888 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    b864c77 View commit details
    Browse the repository at this point in the history

  2. changing printed layer names

    @Benw8888
    Benw8888 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    7d7d97c View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2023

  1. fixed concatenation bug

    @Benw8888
    Benw8888 committed Mar 11, 2023
    Configuration menu
    Copy the full SHA
    4fe61e9 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. minor edits

    @Benw8888
    Benw8888 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    fe61d67 View commit details
    Browse the repository at this point in the history

  2. fixed pyright issues

    @Benw8888
    Benw8888 committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    74da878 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. Merge branch 'main' of github.com:EleutherAI/elk into multi-datasets

    @Benw8888
    Benw8888 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    569ef05 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. Merge branch 'main' into multi-datasets

    @norabelrose
    norabelrose committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    b62b679 View commit details
    Browse the repository at this point in the history

  2. Fix tests

    @norabelrose
    norabelrose committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    fe94c22 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Now working sorta

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    bba24d8 View commit details
    Browse the repository at this point in the history

  2. Skip slow BalancedBatchSampler test

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    03ba6e0 View commit details
    Browse the repository at this point in the history

  3. Slightly relax test_output_is_roughly_balanced

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    15ab351 View commit details
    Browse the repository at this point in the history

  4. Make BalancedSampler deterministic

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    a80369e View commit details
    Browse the repository at this point in the history

  5. InitVar

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    d304ab3 View commit details
    Browse the repository at this point in the history

  6. Support multi class again

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    761c82d View commit details
    Browse the repository at this point in the history

  7. Fix naming issue

    @norabelrose
    norabelrose committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    f29743b View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Support few shot prompts

    @norabelrose
    norabelrose committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    b7b7e23 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into multi-datasets

    @norabelrose
    norabelrose committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    1afb563 View commit details
    Browse the repository at this point in the history

  3. fix multiclass labels

    @AlexTMallen
    AlexTMallen committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    225d4c7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'multi-datasets' of github.com:EleutherAI/elk into multi… 

    …-datasets
    @AlexTMallen
    AlexTMallen committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    9368dc8 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Merge branch 'main' into multi-datasets

    @norabelrose
    norabelrose committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    a858b65 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'multi-datasets' of github.com:EleutherAI/elk into multi… 

    …-datasets
    @norabelrose
    norabelrose committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    5dc2ec6 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2023

  1. Fix dumb part of test failures

    @norabelrose
    norabelrose committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    b1b95e5 View commit details
    Browse the repository at this point in the history

  2. Fix assert_allclose warning

    @norabelrose
    norabelrose committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    ee3911e View commit details
    Browse the repository at this point in the history

  3. Switch to torch.testing.assert_close in EigenReporter test

    @norabelrose
    norabelrose committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    a55b3de View commit details
    Browse the repository at this point in the history

  4. Shuffle load_prompts output by default

    @norabelrose
    norabelrose committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    44dc25c View commit details
    Browse the repository at this point in the history

  5. Fix smoke test failure

    @norabelrose
    norabelrose committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    93d8d87 View commit details
    Browse the repository at this point in the history

  6. Remove debug prints

    @AlexTMallen
    AlexTMallen committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    fad4d74 View commit details
    Browse the repository at this point in the history

  7. Remove more debug print statements

    @AlexTMallen
    AlexTMallen committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    0a054f4 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. make min_memory usable; broadcast mmax_examples in __post_init__

    @AlexTMallen
    AlexTMallen committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    177eec2 View commit details
    Browse the repository at this point in the history

  2. prompt loading refactor to enable better streaming

    @AlexTMallen
    AlexTMallen committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    3a762b0 View commit details
    Browse the repository at this point in the history

  3. remove shuffle arg

    @AlexTMallen
    AlexTMallen committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    f66c054 View commit details
    Browse the repository at this point in the history

  4. remove unused @DataClass

    @lauritowal
    lauritowal committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    d3d87fc View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. merge

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    3d08147 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    c9a43e1 View commit details
    Browse the repository at this point in the history

  3. add concatenated_layer_offset to eval

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    94290aa View commit details
    Browse the repository at this point in the history

  4. Merge branch 'multi-datasets' of https://github.com/EleutherAI/elk in… 

    …to multi-datasets
    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    f9298e4 View commit details
    Browse the repository at this point in the history

  5. add self.

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    3765c4f View commit details
    Browse the repository at this point in the history

  6. replace target with data

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    2b05193 View commit details
    Browse the repository at this point in the history

  7. add self.

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    83731bb View commit details
    Browse the repository at this point in the history

  8. remove second arg

    @lauritowal
    lauritowal committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    764fda9 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. fix passing the wrong params for world size / rank

    @thejaminator
    thejaminator committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    d2c66b0 View commit details
    Browse the repository at this point in the history

  2. Update prompt_loading.py 

    Remove print label
    @lauritowal
    lauritowal committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    9186326 View commit details
    Browse the repository at this point in the history

  3. fix pre-commit errors

    @lauritowal
    lauritowal committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    3f99a4d View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    148130d View commit details
    Browse the repository at this point in the history