Machine Learning Engineering Open Book
A DSL for data-driven computational pipelines
Slurm: A Highly Scalable Workload Manager
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Best practices & guides on how to write distributed pytorch training code
A Slurm cluster using docker-compose
Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
A scheduler for GPU/CPU tasks
Simplify HPC and Batch workloads on Azure
Prometheus exporter for performance metrics from Slurm.
An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.
SEML: Slurm Experiment Management Library
Tools for computation on batch systems
Run Slurm in Kubernetes
Add a description, image, and links to the slurm topic page so that developers can more easily learn about it.
To associate your repository with the slurm topic, visit your repo's landing page and select "manage topics."