Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deal with _encode_pair() / Llama token 29871 / SPIECE_UNDERLINE better #1322

Draft
wants to merge 32 commits into
base: main
Choose a base branch
from
Draft

Deal with _encode_pair() / Llama token 29871 / SPIECE_UNDERLINE better #1322

wants to merge 32 commits into from

Commits on Jan 7, 2024

  1. first stab at wrap_chat_template

    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    3824828 View commit details
    Browse the repository at this point in the history

  2. first stab at wrap_chat_template, strip error fix

    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    a784417 View commit details
    Browse the repository at this point in the history

  3. first stab at wrap_chat_template, rfind continuation fix

    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    53c68db View commit details
    Browse the repository at this point in the history

  4. first stab at wrap_chat_template, formatting in function

    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    3e27f9d View commit details
    Browse the repository at this point in the history

  5. first stab at wrap_chat_template, print statements in loglikelihood f… 

    …or testing
    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    87dff8b View commit details
    Browse the repository at this point in the history

  6. first stab at wrap_chat_template, remove system for now

    @daniel-furman
    daniel-furman committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    5c4d9c7 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. first stab at wrap_chat_template, remove special chars from continuation

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    e689727 View commit details
    Browse the repository at this point in the history

  2. first stab at wrap_chat_template, remove special chars tab indenting … 

    …style fix
    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    337c084 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'EleutherAI:main' into main

    @daniel-furman
    daniel-furman authored Jan 10, 2024
    Configuration menu
    Copy the full SHA
    6c68fd1 View commit details
    Browse the repository at this point in the history

  4. first stab at wrap_chat_template, various

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    34b32f7 View commit details
    Browse the repository at this point in the history

  5. first stab at wrap_chat_template, various

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    59e3b17 View commit details
    Browse the repository at this point in the history

  6. first stab at wrap_chat_template, arc conversation test

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    7191904 View commit details
    Browse the repository at this point in the history

  7. first stab at wrap_chat_template, arc conversation test

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    9949e4f View commit details
    Browse the repository at this point in the history

  8. first stab at wrap_chat_template, remove arc experiment

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2d3c835 View commit details
    Browse the repository at this point in the history

  9. first stab at wrap_chat_template, various

    @daniel-furman
    daniel-furman committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    49f43f9 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    021232b View commit details
    Browse the repository at this point in the history

  2. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    b6c75ed View commit details
    Browse the repository at this point in the history

  3. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    047dde8 View commit details
    Browse the repository at this point in the history

  4. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    c38b9d2 View commit details
    Browse the repository at this point in the history

  5. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    1ea8470 View commit details
    Browse the repository at this point in the history

  6. llama test

    @daniel-furman
    daniel-furman committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    2e27053 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2024

  1. llama test

    @daniel-furman
    daniel-furman committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    43dee06 View commit details
    Browse the repository at this point in the history

  2. llama test

    @daniel-furman
    daniel-furman committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    39a11d0 View commit details
    Browse the repository at this point in the history

  3. remove system

    @daniel-furman
    daniel-furman committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    bbcdffb View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. Merge branch 'main' into add-chat-templating

    @haileyschoelkopf
    haileyschoelkopf committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    2b40017 View commit details
    Browse the repository at this point in the history

  2. update Instance.args setter

    @haileyschoelkopf
    haileyschoelkopf committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    c47de8b View commit details
    Browse the repository at this point in the history

  3. clean up wrap_chat_template + add TODOs

    @haileyschoelkopf
    haileyschoelkopf committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    6ca8ab1 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into add-chat-templating

    @haileyschoelkopf
    haileyschoelkopf committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    b8bda47 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. push most recent code

    @haileyschoelkopf
    haileyschoelkopf committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    68c30aa View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. add the hack (works for Mistral/Llama, destroys performance for GPT2

    @haileyschoelkopf
    haileyschoelkopf committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    d03c9fd View commit details
    Browse the repository at this point in the history

  2. add the hack (works for Mistral/Llama, destroys performance for GPT2

    @haileyschoelkopf
    haileyschoelkopf committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    42d54f8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix-len0-continuations' of https://github.com/EleutherA… 

    …I/lm-evaluation-harness into fix-len0-continuations
    @haileyschoelkopf
    haileyschoelkopf committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    787c99e View commit details
    Browse the repository at this point in the history