Skip to content
This repository has been archived by the owner on Mar 21, 2024. It is now read-only.

(Attempt 2) Enable building an ensemble model from the cross validation checkpoints of a BYO Lightning model #549

Closed
wants to merge 27 commits into from

Conversation

dumbledad
Copy link
Contributor

@dumbledad dumbledad commented Aug 3, 2021

Closing #527
Replacing #529

The method MLRunner.run_inference_for_lightning_models takes a list of checkpoint paths as an argument, but then makes sure that there is only one used (here):

    if len(checkpoint_paths) != 1:
        raise ValueError(f"This method expects exactly 1 checkpoint for inference, but got {len(checkpoint_paths)}")

We want to change this so that the checkpoints gleaned from a BYOL cross validation run can be used as an ensemble model.

  • This will use the methods defined in the InnerEyeInference abstract class. We expect that these methods are sufficient, but an extension or redesign may be required.
  • Use the simple linear regression model as the basis of an exemplar.
  • It would be great to use another, more realistic model, e.g. the Single Cell model?

AB#4219

So we can debug what goes wrong with ensemble
reporting on AML for BYO Lightning
@ant0nsc ant0nsc closed this Oct 22, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enable building an ensemble model from the cross validation checkpoints of a BYOL model
2 participants