8 results found Sort:

LiyuanLucasLiu
RAdam LiyuanLucasLiu
334
2.5k
apache-2.0
58
On the Variance of the Adaptive Learning Rate and Beyond
adam warmup optimizer adam-optimizer
Created 2019-08-01
73 commits to master branch, last one 3 years ago
parasdahal
deepnet parasdahal
84
322
mit
17
Educational deep learning library in plain Numpy.
cnn adagrad dropout adam-optimizer batch-normalization nesterov-accelerated-sgd
Created 2017-06-03
20 commits to master branch, last one 5 years ago
SirRob1997
Crowded-Valley---Results SirRob1997
19
180
unknown
5
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
sgd deeplearning deep-learning adam-optimizer deep-neural-networks deep-learning-optimizers
Created 2020-06-30
48 commits to master branch, last one 3 years ago
tirtharajdash
CS-F425_Deep-Learning tirtharajdash
3
107
mit
21
CS F425 Deep Learning course at BITS Pilani (Goa Campus)
bits-pilani optimisation deep-learning adam-optimizer generative-model machine-learning deep-neural-networks
Created 2021-08-18
99 commits to main branch, last one about a year ago
YanaiEliyahu
AdasOptimizer YanaiEliyahu
11
85
mit
7
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achiev...
adam mnist optimizer deep-learning adam-optimizer machine-learning artifical-neural-network
Created 2020-04-10
99 commits to master branch, last one 3 years ago
nengwp
Lion-vs-Adam nengwp
7
56
unknown
2
Lion and Adam optimization comparison
vis adam lion adam-optimizer lion-optimization
Created 2023-02-21
5 commits to master branch, last one about a year ago
v-iashin
CS231n v-iashin
9
51
unknown
2
PyTorch/Tensorflow solutions for Stanford's CS231n: "CNNs for Visual Recognition"
lstm numpy pytorch solutions assignment tensorflow deep-learning sgd-optimizer adam-optimizer neural-network style-transfer svm-classifier backpropagation computer-vision jupyter-notebook machine-learning stanford-university recurrent-neural-networks convolutional-neural-networks generative-adversarial-network
Created 2018-04-08
40 commits to master branch, last one 3 years ago
shreyansh26
ML-Optimizers-JAX shreyansh26
2
43
unknown
3
Toy implementations of some popular ML optimizers using Python/JAX
jax adam momentum optimizers adam-optimizer gradient-descent machine-learning optimization-algorithms
Created 2021-06-20
9 commits to master branch, last one 3 years ago