Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a runner for MosaicML cloud #44

Merged
merged 24 commits into from
Feb 3, 2023
Merged

Add a runner for MosaicML cloud #44

Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
452b697
add mosaic launcher string constant
dakinggg Jan 25, 2023
2a4363a
first attempt at mosaic multinode runner for gptneox
dakinggg Jan 25, 2023
854f08d
typo
dakinggg Jan 25, 2023
3ae75e0
actually add mosaic runner
dakinggg Jan 26, 2023
0f563f4
string cast
dakinggg Jan 26, 2023
7a491c1
debug
dakinggg Jan 26, 2023
cacc9e1
fix
dakinggg Jan 26, 2023
cd4e777
actually fix?
dakinggg Jan 26, 2023
fa519a5
strip extra space
dakinggg Jan 26, 2023
7ceecc4
debugging
dakinggg Jan 26, 2023
2ff4a5a
debugging
dakinggg Jan 26, 2023
9ecf28e
correctly set env vars
dakinggg Jan 26, 2023
1e3f016
drop cd
dakinggg Jan 26, 2023
a9e83df
add env vars via env instead of export commands
dakinggg Jan 26, 2023
45573c8
fix
dakinggg Jan 26, 2023
80a3160
try using slurms arg parsing
dakinggg Jan 26, 2023
8eaa8f8
debug print
dakinggg Jan 26, 2023
2c3a9ea
debug print
dakinggg Jan 26, 2023
935184f
print debug
dakinggg Jan 26, 2023
9bd144f
cleanup
dakinggg Jan 26, 2023
051b9cc
try getting world info from the hostfile
dakinggg Jan 26, 2023
2224df9
add missing init arg
dakinggg Jan 26, 2023
8e8a3a0
more cleanup
dakinggg Jan 26, 2023
c84505c
remove more prints
dakinggg Jan 26, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Next Next commit
add mosaic launcher string constant
  • Loading branch information
@dakinggg
dakinggg committed Jan 25, 2023
commit 452b697a94339ce46c768c66981de51efa77578d
1 change: 1 addition & 0 deletions deepspeed/launcher/constants.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@

OPENMPI_LAUNCHER = 'openmpi'
SLURM_LAUNCHER = 'slurm'
MOSAICML_LAUNCHER = 'mosaicml'

MVAPICH_LAUNCHER = 'mvapich'
MVAPICH_TMP_HOSTFILE = '/tmp/deepspeed_mvapich_hostfile'