Deep Learning with Methylation
MethylNet is a command line tool and python library that provides classes to handle deep learning tasks for methylation data. It is built off of pythonic MethylationArray data types introduced in (https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess), and uses PyTorch to explore/make predictions on the methylation data.
What MethylNet can do:
- Extract DNA Methylation Latent Space by training Variational Auto-encoders (VAE) after hyperparameter and neural network topology grid-search.
2. Make classification, single- and multi-output regression predictions on the methylation data such as age, cell type proportions, and disease state. This is done after transfer learning the VAE topology and a hyperparameter and neural network topology grid-search.
3. Find most important CpGs for predictions using SHAP, interpreting predictions on the individual and aggragated class level.
4. Interrogate these extracted CpGs using popular pipelines such as LOLA, gometh, GSEA and overlap CpGs with other known sets of CpGs. In addition, overlap top sets of CpGs with other CpGs of other predictions.
NOTE: Images will be updated to reflect latest set of MethylNet commands.
Install (Conda highly recommended, though Docker can be used):
- conda create -n methylnet python=3.6
- source activate methylnet
- See install instructions for PyMethylProcess at https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess
- conda install pytorch torchvision -c pytorch
- pip install methylnet
- download_help_data
- Alternative docker install coming out soon.
* If looking to use only CPUs, only core docker or singularity needed, and see singulairty website for information on how to pull Docker images
* See https://singularity.lbl.gov/faq#does-singularity-support-containers-that-require-gpus for information on getting Singularity to work with GPUs
* nvidia-docker is also the Docker equivalent to run GPU jobs - GPU usage is also possible through the base install (without Docker), provided that your machine has GPU access.
Running MethylNet:
- source activate methylnet
- Pre-processing pipeline: Instructions available at https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess to go from 450K/850K IDATs to MethylationArray datatypes that can easily be learned from.
- Run embedding hyperparameter scan
- Choose top embedding hyperparameters and train one last time again
- Run prediction hyperparameter scan
- Choose top prediction hyperparameters and train one last time again
- Find top CpGs by running SHAP.
- Interrogate SHAP derived CpGs.
- See help-docs for usage.
Example of Running Pipeline:
See ./example_scripts for examples on how to explicitly run:
