ML Launchpad lets you easily make Machine Learning models available as REST API (or any kind of microservice). It also offers lightweight model life cycle management functionality.
It creates a separation between machine learning models and their environment. This way, you can run your model with different data sources. and on different environments, by just swapping out the configuration, no code changes required. ML Launchpad makes your model available as a business-facing RESTful API without extra coding.
Currently, some basic model life cycle management is supported. Training automatically persists a model in the model store together with its metrics, and automatically retrieves it for launching its API or re-training. Previous models are backed up.
The full documentation is available at https://mllaunchpad.readthedocs.io.
To learn more about the rationale and structure of ML Launchpad, see Description.
$ pip install mllaunchpad
Download the example files from the ML Launchpad GitHub repo. Some of them might require the installations of some extra packages (e.g. scikit-learn), depending on what they demonstrate.
For more about installation, or if you don't want to use pip
and instead install from source (as a user), please see the section Installation.
If you want to work on ML Launchpad itself, see Contributing.
If you downloaded the source, you see several subfolders, where mllaunchpad
is the actual ML Launchpad package and the rest are examples and
development tools. You can safely ignore anything except the examples.
The examples
contain a few example model implementations.
Look here for inspiration on how to use this package. Every model here
consists of at least three files:
<examplename>_model.py
: the example's actual model code<examplename>_cfg.yml
: the example's configuration file<examplename>.raml
: example's RESTful API specification. Used, among others, to parse and validate parameters.- There are also some extra files, like CSV files to use, or datasource. extensions.
The subfolder testserver
contains an example for running a REST API
in gunicorn behind nginx.
In the following, it is assumed that mllaunchpad
is installed and
the examples are located in the current directory.
To train a very, very simple example model whose job it is to add two numbers, use the command:
$ mllaunchpad -c addition_cfg.yml t
(We give it a config file after the -c
parameter, and t
is
short for the command train
. There's also a parameter -h
to
print help. For all details of the command line interface, see
the Usage section.)
Some log information is printed (you can give it a log-config file to change this, see examples/logging_cfg.yml). At the end, it should say “Created and stored trained model”, followed by something about metrics.
This created a model_store if it didn't exist yet (which for now is just
a directory). For our examples, the model store is conveniently located
in the same directory. It contains our persisted addition
model and
its metadata.
To re-test the previously trained model, use the command r
:
$ mllaunchpad -c addition_cfg.yml r
To run a (debugging-only!) REST API for the model, use the command
a
:
$ mllaunchpad -c addition_cfg.yml a
To quickly try out out our fancy addition model API, open this link in a
browser: https://127.0.0.1:5000/add/v0/sum?x1=3&x2=2
(curl "https://127.0.0.1:5000/add/v0/sum?x1=3&x2=2"
on the command
line)
Have a look at the addition
example's python code (and comments),
its yml config, then look at the other examples. First, we suggest the
tree
example for intermediate complexity (although its prediction
code does quite some complex stuff to be compatible with three different
kinds of prediction usage, which is not really that realistic).
If you are wondering about the RAML file (which is a RESTful API
specification standard that is used in some corporate environments, and
a good idea in general), also look at the g
(generate-raml
) command
line parameter, which does a lot of work (almost all of it, in fact) for
getting you started with a first RAML.
To learn how to use ML Launchpad, see Usage.
For more details on how ML Launchpad actually works and why we created it, see In Depth.
In case the console command mllaunchpad <your_arguments>
is not recognized,
try:
$ python -m mllaunchpad <your_arguments>
If you get an error like No module named 'your_model'
, the file
your_model.py
is not in the python path. You can try to set the
PYTHONPATH environment variable
to the path(s) to your file(s), or, if you're using mllaunchpad
from your own python code, append the path(s) to
sys.path.
If you get ModuleNotFoundError: No module named 'mllaunchpad'
(in
mllaunchpad/__main__.py
), try to start flask the following way:
$ export FLASK_APP=mllaunchpad.wsgi:application
$ export LAUNCHPAD_CFG=addition_cfg.yml
$ flask run
(On Windows, use set
instead of export
)
This problem appears to be connected to Flask restarting in different ways on different installations. If you know what exactly this is about, please let us know.