Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory profiling #1153

Merged
merged 32 commits into from
Feb 21, 2024
Merged
Changes from 1 commit
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
f5fd54c
Fixes distributed tests, and skips tests that are broken.
jahatef Feb 14, 2024
4a4a934
Merge branch 'main' of github.com:EleutherAI/gpt-neox into main
jahatef Feb 18, 2024
f63593b
memory profiling for gpt-neox. Only works for pp=0, pp=1+ needs DS co…
jahatef Feb 20, 2024
4ed9d42
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
89efc48
adds memory profiling for pipeline parallel
jahatef Feb 21, 2024
95f31f0
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
9551afe
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
4135743
fix spacing
jahatef Feb 21, 2024
7b0cdaf
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
45aea7a
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
3bff276
fix spacing again
jahatef Feb 21, 2024
2452697
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
d9c7e4b
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
7af1c9d
get rid of unwanted changes
jahatef Feb 21, 2024
47f76af
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
7994909
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
a2893db
get rid of file
jahatef Feb 21, 2024
db8b70b
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
80b1e30
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
7467632
Merge branch 'main' into memory_profiling
Quentin-Anthony Feb 21, 2024
5c51c43
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
20bc950
add nsight systems support
jahatef Feb 21, 2024
fd0b471
Merge branch 'memory_profiling' of github.com:EleutherAI/gpt-neox int…
jahatef Feb 21, 2024
87bca9d
remove tests changes again
jahatef Feb 21, 2024
65ce859
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
49cf95d
add tests
jahatef Feb 21, 2024
ab8126d
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
ae2c61d
Update training.py
jahatef Feb 21, 2024
21eba94
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
edfcdaf
Add assertion message
Quentin-Anthony Feb 21, 2024
8669123
pre-commit
Quentin-Anthony Feb 21, 2024
80aa4cb
Update NeoXArgs docs automatically
invalid-email-address Feb 21, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update NeoXArgs docs automatically
  • Loading branch information
github-actions committed Feb 21, 2024
commit 5c51c436e4cb723c8a4dfeb93444064350d7ef8f
2 changes: 1 addition & 1 deletion configs/neox_arguments.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ Logging Arguments

- **git_hash**: str

Default = 0eb8b39
Default = 7467632

current git hash of repository

Expand Down