kozistr / pytorch_optimizer Star 194 Code Issues Pull requests Discussions optimizer & lr scheduler & loss function collections in PyTorch deep-learning sam optimizer pytorch ranger loss-functions chebyshev lookahead nero adabound learning-rate-scheduling radam diffgrad gradient-centralization adamp adabelief madgrad adamd adan adai Updated May 21, 2024 Python
Dawn-Of-Eve / nadir Star 11 Code Issues Pull requests Nadir is a library of bleeding-edge optimisers built for speed and functionality in PyTorch for researchers 💙 machine-learning optimization pytorch lion adam-optimizer adamax sgd-optimizer amsgrad adamw radam adamp adabelief Updated May 1, 2024 Python
Dawn-Of-Eve / awesome-optimizers Star 9 Code Issues Pull requests Literature survey of convex optimizers and optimisation methods for deep-learning; made especially for optimisation researchers with ❤️ awesome eve awesome-list optimization-algorithms adam shampoo adamw radam adamp Updated Mar 9, 2023