Published April 27, 2026 | Version v3.1.1
Software Open

HeavyBall

Description

Compile-first PyTorch optimizer library: AdamW, Muon, SOAP/Shampoo, PSGD, Schedule-Free, and 30+ more, assembled from composable transforms under torch.compile.

Notes

If you use HeavyBall in your research, please cite it as below.

Files

HomebrewML/HeavyBall-v3.1.1.zip

Files (3.8 MB)

Name Size Download all
md5:6f5a50a346c8da8e57fbac45c6513662
3.8 MB Preview Download

Additional details

Related works