You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
@@ -202,15 +202,14 @@ class NeoXArgsDeepspeedRunner(NeoXArgsTemplate):
If true, autodetects nvlink pairs and remaps cuda visible devices to place them next to each other. This is an Eleuther addition to deepspeed, and should speed up model parallel training on setups with nvlink pairs when mp=2.
"""
autotuning_run: str=None
"""
Either "tune", "run", or `None`.
"""
no_ssh_check: bool=False
"""
If true, overrides the default check where DeepSpeed confirms that the headnode is accessible via ssh.