Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Memory profiling #1153

Merged
merged 32 commits into from
Feb 21, 2024
Merged

Memory profiling #1153

merged 32 commits into from
Feb 21, 2024

Commits on Feb 14, 2024

  1. Fixes distributed tests, and skips tests that are broken.

    @jahatef
    jahatef committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    f5fd54c View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. Merge branch 'main' of github.com:EleutherAI/gpt-neox into main

    @jahatef
    jahatef committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    4a4a934 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. memory profiling for gpt-neox. Only works for pp=0, pp=1+ needs DS co… 

    …mmits.
    @jahatef
    jahatef committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    f63593b View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    4ed9d42 View commit details
    Browse the repository at this point in the history

  2. adds memory profiling for pipeline parallel

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    89efc48 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    95f31f0 View commit details
    Browse the repository at this point in the history

  4. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    9551afe View commit details
    Browse the repository at this point in the history

  5. fix spacing

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    4135743 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7b0cdaf View commit details
    Browse the repository at this point in the history

  7. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    45aea7a View commit details
    Browse the repository at this point in the history

  8. fix spacing again

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    3bff276 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    2452697 View commit details
    Browse the repository at this point in the history

  10. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    d9c7e4b View commit details
    Browse the repository at this point in the history

  11. get rid of unwanted changes

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7af1c9d View commit details
    Browse the repository at this point in the history

  12. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    47f76af View commit details
    Browse the repository at this point in the history

  13. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7994909 View commit details
    Browse the repository at this point in the history

  14. get rid of file

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    a2893db View commit details
    Browse the repository at this point in the history

  15. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    db8b70b View commit details
    Browse the repository at this point in the history

  16. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    80b1e30 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'main' into memory_profiling

    @Quentin-Anthony
    Quentin-Anthony committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7467632 View commit details
    Browse the repository at this point in the history

  18. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    5c51c43 View commit details
    Browse the repository at this point in the history

  19. add nsight systems support

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    20bc950 View commit details
    Browse the repository at this point in the history

  20. Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int… 

    …o memory_profiling
    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    fd0b471 View commit details
    Browse the repository at this point in the history

  21. remove tests changes again

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    87bca9d View commit details
    Browse the repository at this point in the history

  22. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    65ce859 View commit details
    Browse the repository at this point in the history

  23. add tests

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    49cf95d View commit details
    Browse the repository at this point in the history

  24. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    ab8126d View commit details
    Browse the repository at this point in the history

  25. Update training.py

    @jahatef
    jahatef committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    ae2c61d View commit details
    Browse the repository at this point in the history

  26. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    21eba94 View commit details
    Browse the repository at this point in the history

  27. Add assertion message

    @Quentin-Anthony
    Quentin-Anthony committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    edfcdaf View commit details
    Browse the repository at this point in the history

  28. pre-commit

    @Quentin-Anthony
    Quentin-Anthony committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    8669123 View commit details
    Browse the repository at this point in the history

  29. Update NeoXArgs docs automatically

    github-actions committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    80aa4cb View commit details
    Browse the repository at this point in the history