Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft: NetpuneLogger checkpoint saving reworked #19144

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
TODOs removed
  • Loading branch information
Raalsky committed Dec 12, 2023
commit 91f38e606e8b86069b373a09cad93a5da0de2664
4 changes: 2 additions & 2 deletions src/lightning/pytorch/loggers/neptune.py
Original file line number Diff line number Diff line change
Expand Up @@ -561,8 +561,8 @@ def _delete_old_best_checkpoints(self, new_best_models_names: Set[str], checkpoi
for model_name in tuple(self._uploaded_best_checkpoints - new_best_models_names):
if model_name in self._uploaded_best_checkpoints:
if self.run.exists(f"{checkpoints_namespace}/{model_name}"):
del self.run[f"{checkpoints_namespace}/{model_name}"] # TODO: Cover in tests
self._uploaded_best_checkpoints.remove(model_name) # TODO: Cover in tests
del self.run[f"{checkpoints_namespace}/{model_name}"]
self._uploaded_best_checkpoints.remove(model_name)

@staticmethod
def _get_full_model_name(model_path: str, checkpoint_callback: Checkpoint) -> str:
Expand Down
Loading