ZO-Library
Open-source library for memory-efficient zero-order optimization
An open-source PyTorch-style library for zeroth-order optimization, enabling memory-efficient fine-tuning of LLMs with up to 50% memory reduction. Implements SignSGD, Muon, and all novel momentum-based ZO methods.