Monarch

Monarch is a single-controller library for PyTorch, providing a centralized orchestration layer for distributed training. It simplifies multi-GPU and multi-node training by managing communication, checkpointing, and fault tolerance. Currently at version 0.5.0, it requires Python >=3.10 and is under active development.