Skip to content
This repository has been archived by the owner on Mar 21, 2024. It is now read-only.

Ensure that models are registered with consistent file structure #276

Merged
merged 73 commits into from
Nov 16, 2020

Conversation

ant0nsc
Copy link
Contributor

@ant0nsc ant0nsc commented Oct 9, 2020

  • Make file structure consistent across normal training and training when InnerEye is a submodule
  • Add test coverage for the file structure of registered models
  • Add documentation around how the model structure looks like
  • If multiple Conda files are used in an InnerEye run, they are merged into one environment file for deployment. The complicated merge inside of run_scoring could be deprecated in principle, but leaving it there if we need for legacy models.
  • Add test coverage for submit_for_inference: Previous test was using a hardcoded legacy model, meaning that any changes to model structure could have broken the script
  • The test for submit_for_inference is no longer submitted from the big AzureML run, shortening the runtime of that part of the PR build. Instead, it is triggered after the TrainViaSubmodule part of the build. The corresponding AzureML experiment is no longer model_inference, but the same experiment as all other AzureML runs.
  • The test for submit_for_inference was previously running on the expensive training-nd24 cluster, now on the cheaper nc12.
  • submit_for_inference now correctly uses the score.py file that is inside of the model, rather than copying it from the repository root.

@ant0nsc ant0nsc marked this pull request as draft October 26, 2020 21:42
docs/deploy_on_aml.md Outdated Show resolved Hide resolved
Shruthi42
Shruthi42 previously approved these changes Nov 13, 2020
InnerEye/ML/run_ml.py Outdated Show resolved Hide resolved
InnerEye/ML/run_ml.py Outdated Show resolved Hide resolved
InnerEye/ML/run_ml.py Outdated Show resolved Hide resolved
InnerEye/ML/run_ml.py Show resolved Hide resolved
InnerEye/ML/run_ml.py Outdated Show resolved Hide resolved
InnerEye/Scripts/download_model_and_run_scoring.py Outdated Show resolved Hide resolved
InnerEye/Scripts/download_model_and_run_scoring.py Outdated Show resolved Hide resolved
@ant0nsc ant0nsc linked an issue Nov 13, 2020 that may be closed by this pull request
Shruthi42
Shruthi42 previously approved these changes Nov 13, 2020
fix registration issue
@ant0nsc ant0nsc merged commit cd4458e into master Nov 16, 2020
@ant0nsc ant0nsc deleted the antonsc/230_inference branch November 16, 2020 10:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
3 participants