You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The function setup_model_and_optimizer is used for evaluation and inference as a hack to initialize DeepSpeed properly. However, there was a recent change to make sure that the LR scheduler is properly updated after resuming training from a checkpoint that assumes there will be an lr_scheduler object. Right attempting to run evaluate.py from NeoX main gives
File "/mnt/ssd-1/dashiell/gpt-neox/megatron/utils.py", line 448, in setup_for_inference_or_eval
lr_scheduler.optimizer = model.optimizerlr_scheduler.optimizer = model.optimizer
lr_scheduler.optimizer = model.optimizerAttributeError
AttributeError: : 'NoneType' object has no attribute 'optimizer''NoneType' object has no attribute 'optimizer'
The text was updated successfully, but these errors were encountered:
The function
setup_model_and_optimizer
is used for evaluation and inference as a hack to initialize DeepSpeed properly. However, there was a recent change to make sure that the LR scheduler is properly updated after resuming training from a checkpoint that assumes there will be anlr_scheduler
object. Right attempting to runevaluate.py
from NeoX main givesThe text was updated successfully, but these errors were encountered: