3 results found Sort:

vballoli
nfnets-pytorch vballoli
29
344
mit
8
NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
sgd sota paper nfnets pytorch deepmind image-classification adaptive-gradient-clipping
Created 2021-02-13
80 commits to main branch, last one 2 years ago
VITA-Group
BNN_NoBN VITA-Group
10
57
mit
8
[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
normalizer-free batch-normalization binary-neural-networks weight-standardization adaptive-gradient-clipping normalization-free-training
Created 2021-04-14
10 commits to main branch, last one 3 years ago
andreped
GradientAccumulator andreped
11
53
mit
4
:dart: Accumulated Gradients for TensorFlow 2
gpu tf2 tpu keras float16 multi-gpu batch-size tensorflow huggingface tensorflow2 deep-learning hacktoberfest mixed-precision memory-constraints distributed-training accumulated-gradients gradient-accumulation adaptive-gradient-clipping accumulated-batch-normalization
Created 2022-05-31
698 commits to main branch, last one 11 months ago