This repository showcases a problem with resuming training from an LR schedule based on CosineAnnealingWarmRestarts, and proposes a fix. See script/repro.ipynb for details.