Search Results - RepositoryStats

annotated_deep_learning_paper_implementations labmlai

6.1k

60.2k

mit

473

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga...

gan lora pytorch attention optimizers transformer transformers deep-learning neural-networks machine-learning literate-programming deep-learning-tutorial reinforcement-learning

Created 2020-08-25

829 commits to master branch, last one 8 months ago

lion-pytorch lucidrains

55

2.1k

mit

14

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

optimizers deep-learning evolutionary-search artificial-intelligence

Created 2023-02-15

49 commits to main branch, last one 4 months ago

axon elixir-nx

109

1.6k

apache-2.0

44

Nx-powered Neural Networks

nx elixir optimizers deep-learning neural-networks

Created 2021-01-25

607 commits to main branch, last one 3 days ago

opytimizer gugarosa

42

615

apache-2.0

14

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

python optimizers bioinspired optimization meta-heuristic artificial-intelligence meta-heuristic-optimization

Created 2017-11-01

821 commits to main branch, last one 8 months ago

Gradient-Centralization Yonghongwei

81

535

unknown

17

A New Optimization Technique for Deep Neural Networks

optimizers deep-neural-networks optimization-technique gradient-centralization

Created 2020-03-31

138 commits to master branch, last one 3 years ago

keras-radam CyberZHG

46

325

mit

14

RAdam implemented in Keras & TensorFlow

adam keras radam optimizers tensorflow rectified-adam

This repository has been archived (exclude archived)

Created 2019-08-16

38 commits to master branch, last one 3 years ago

keras-adamw OverLordGoldDragon

25

167

mit

6

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

sgd adamw keras nadam adamwr optimizers tensorflow warm-restarts learning-rate-multipliers

Created 2019-09-27

53 commits to master branch, last one 3 years ago

fer usef-kh

38

109

unknown

2

Code for the paper "Facial Emotion Recognition: State of the Art Performance on FER2013"

fer loss tuning vggnet fer2013 optimizers schedulers architecture saliency-maps facial-emotions

Created 2021-05-06

13 commits to master branch, last one about a year ago

DL4S palle-k

13

108

mit

4

Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

swift tensor autograd optimizers derivatives deep-learning neural-networks gradient-descent machine-learning recurrent-networks deep-neural-networks swift-machine-learning automatic-differentiation recurrent-neural-networks convolutional-neural-networks

Created 2019-03-10

311 commits to master branch, last one 3 years ago

Gradient-Centralization-TensorFlow Rishit-dagli

22

106

apache-2.0

5

Instantly improve your training performance of TensorFlow models with just 2 lines of code!

pip python python3 optimizers tensorflow tensorflow2 deep-learning neural-network python-package machine-learning deep-neural-networks optimization-technique gradient-centralization

Created 2021-02-15

104 commits to main branch, last one 3 years ago