HeavyBall: Compile-first PyTorch optimizer library
JSON →HeavyBall is a PyTorch optimizer library that emphasizes 'compile-first' design, assembling optimizers from composable, compiled building blocks. It provides API-compatible replacements for `torch.optim` optimizers like AdamW, SGD, and RMSprop, along with over 30 specialized optimizers such as Muon, SOAP/Shampoo, PSGD, and Schedule-Free. Currently at version 3.0.0, the library is actively maintained with a focus on `torch.compile` fusion, Triton kernel optimization, and memory efficiency, including features like ECC state compression.
Traffic · last 30 days ↑67% vs prev 7d
total hits 15
actors 6 distinct systems
last hit 3d ago MetaBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇳🇴 Norway · 🇩🇪 Germany
API endpoints
full doc /v1/registry/heavyball
install /v1/registry/heavyball/install
compatibility /v1/registry/heavyball/compatibility