deep-learning-optimizers

Here are 5 public repositories matching this topic...

SirRob1997 / Crowded-Valley---Results

This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"

deep-neural-networks deep-learning sgd deeplearning adam-optimizer deep-learning-optimizers

Updated Jul 17, 2021

HAYDARKILIC / optimization_methods

Star

Advanced Mathematical Optimization & Deep Learning Optimizers from scratch. Covers KKT duality, L-BFGS, proximal methods (ADMM, FISTA), stochastic algorithms (SVRG, Lion), and cutting-edge deep learning optimizers like K-FAC, Shampoo, Sophia, SAM, and Muon. Bridging strict convex calculus with large-scale Transformer training.

python admm convex-optimization distributed-optimization l-bfgs stochastic-optimization mathematical-optimization deep-learning-optimizers proximal-gradient transformer-training

Updated May 27, 2026
Jupyter Notebook

junaidaliop / guava-classification

Star

Guava Disease Classification using DenseNet-Reloaded and ADOPT optimizer. Achieves 99.73% accuracy in Anthracnose, Fruit Fly, and Healthy Guava detection.

image-classification densenet deep-learning-optimizers ai-in-agriculture