Skip to content

Commit

Permalink
Update deepspeed_args.py (#823)
Browse files Browse the repository at this point in the history
Missing end of comment
  • Loading branch information
GregorySenay committed Mar 10, 2023
1 parent 9610391 commit 6edf241
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions megatron/neox_arguments/deepspeed_args.py
Original file line number Diff line number Diff line change
Expand Up @@ -202,15 +202,14 @@ class NeoXArgsDeepspeedRunner(NeoXArgsTemplate):
If true, autodetects nvlink pairs and remaps cuda visible devices to place them next to each other. This is an Eleuther addition to deepspeed, and should speed up model parallel training on setups with nvlink pairs when mp=2.
"""


autotuning_run: str = None
"""
Either "tune", "run", or `None`.
"""

no_ssh_check: bool = False
"""
If true, overrides the default check where DeepSpeed confirms that the headnode is accessible via ssh.

"""

comment: str = None
Expand Down

0 comments on commit 6edf241

Please sign in to comment.