Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deepspeed benchmarking #878

Draft
wants to merge 24 commits into
base: main
Choose a base branch
from
Draft

Deepspeed benchmarking #878

wants to merge 24 commits into from

Commits on Mar 29, 2023

  1. add flash_attn_kvpacked

    @satpalsr
    satpalsr committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    f4706e0 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Changed is_pipe_parallel setting to fix pipeline-parallel inference

    @curt-tigges
    curt-tigges committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    f4a9106 View commit details
    Browse the repository at this point in the history

  2. Update NeoXArgs docs automatically

    github-actions committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    83a7b9a View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. fix formatting

    @satpalsr
    satpalsr committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    45d7052 View commit details
    Browse the repository at this point in the history

  2. gpt benchmark script

    @cr458
    cr458 committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    857c556 View commit details
    Browse the repository at this point in the history

  3. remove duplicate argparse

    @cr458
    cr458 committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    1ab5bf3 View commit details
    Browse the repository at this point in the history

  4. HF inference

    @cr458
    cr458 committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    afb6b29 View commit details
    Browse the repository at this point in the history

  5. benchmarking configs + script changes

    @cr458
    cr458 committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    3f7d605 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. plot directly, runs deepspeed and hf for single benchmark

    @cr458
    cr458 committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    d99d2ce View commit details
    Browse the repository at this point in the history

  2. remove plotting comments

    @cr458
    cr458 committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    b0e9745 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. accept changes from main & resolve conflicts

    @satpalsr
    satpalsr committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    9c645dd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into flash_attn_infer

    @satpalsr
    satpalsr committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    ee99945 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. tmp changes

    @cr458
    cr458 committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    9b1733e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'satpalsr/flash_attn_infer' into deepspe… 

    …ed-bench
    @cr458
    cr458 committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    22cac56 View commit details
    Browse the repository at this point in the history

  3. merge conflict git hash

    @cr458
    cr458 committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    466749b View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. separate scripts for Deepspeed/HF and neox

    @cr458
    cr458 committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    b10739f View commit details
    Browse the repository at this point in the history

  2. debugging: works when world size > 1 but not otherwise

    @cr458
    cr458 committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    4990f9b View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. working ( but not serially)

    @cr458
    cr458 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    88981b2 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. working ish gpt-neox just need to figure out how to get dataframe back

    @cr458
    cr458 committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    5e3ca7f View commit details
    Browse the repository at this point in the history

  2. get dataframe output from stdout

    @cr458
    cr458 committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    3ee9d3b View commit details
    Browse the repository at this point in the history

Commits on May 21, 2023

  1. remove gpt neox inference from script

    @cr458
    cr458 committed May 21, 2023
    Configuration menu
    Copy the full SHA
    2a6e8cd View commit details
    Browse the repository at this point in the history

  2. remove lines

    @cr458
    cr458 committed May 21, 2023
    Configuration menu
    Copy the full SHA
    7ea22d9 View commit details
    Browse the repository at this point in the history

  3. device error

    @cr458
    cr458 committed May 21, 2023
    Configuration menu
    Copy the full SHA
    ef4fdd4 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Add DS inference

    @satpalsr
    satpalsr committed May 22, 2023
    Configuration menu
    Copy the full SHA
    d8184f3 View commit details
    Browse the repository at this point in the history