Machine Learning Engineering Open Book
-
Updated
Sep 16, 2024 - Python
Machine Learning Engineering Open Book
A DSL for data-driven computational pipelines
Slurm: A Highly Scalable Workload Manager
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
A Slurm cluster using docker-compose
Simplify HPC and Batch workloads on Azure
A scheduler for GPU/CPU tasks
Prometheus exporter for performance metrics from Slurm.
An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.
Tools for computation on batch systems
SEML: Slurm Experiment Management Library
A toolset for black-box hyperparameter optimisation.
A simple Snakemake profile for Slurm without --cluster-config
Add a description, image, and links to the slurm topic page so that developers can more easily learn about it.
To associate your repository with the slurm topic, visit your repo's landing page and select "manage topics."