6 results found Sort:

Tony-Y
pytorch_warmup Tony-Y
24
401
mit
5
Learning Rate Warmup in PyTorch
adam warmup pytorch deep-learning learning-rate-scheduling
Created 2019-10-31
108 commits to master branch, last one 8 days ago
kozistr
pytorch_optimizer kozistr
23
265
apache-2.0
6
optimizer & lr scheduler & loss function collections in PyTorch
sam adai adan nero adamd adamp radam ranger madgrad pytorch adabound ademamix diffgrad adabelief lookahead optimizer deep-learning loss-functions gradient-centralization learning-rate-scheduling
Created 2021-09-21
3,594 commits to main branch, last one 4 days ago
cmpark0126
pytorch-polynomial-lr-decay cmpark0126
13
65
mit
0
Polynomial Learning Rate Decay Scheduler for PyTorch
pytorch deep-learning pytorch-extension learning-rate-decay learning-rate-scheduling
Created 2019-07-18
11 commits to master branch, last one 4 years ago
Lance0218
Pytorch-DistributedDataParallel-Training-Tricks Lance0218
11
62
mit
2
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
apex warmup pytorch distributed random-seeds early-stopping learning-rate-scheduling pytorch-distributeddataparallel
Created 2020-08-25
15 commits to master branch, last one 2 years ago
abhuse
cyclic-cosine-decay abhuse
8
48
mit
3
Pytorch cyclic cosine decay learning rate scheduler
pytorch learning-rate-decay learning-rate-scheduling
Created 2019-09-10
2 commits to master branch, last one 3 years ago
YuchenJin
autolrs YuchenJin
9
44
mit
3
Automatic learning-rate scheduler
automl deep-learning machine-learning hyperparameter-tuning learning-rate-scheduling
Created 2021-03-16
4 commits to main branch, last one 3 years ago