6 results found Sort:

amirgholami
PyHessian amirgholami
121
702
mit
14
PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
hessian hessian-free second-order pytorch-library second-order-optimization
Created 2019-11-20
40 commits to master branch, last one 11 months ago
amirgholami
adahessian amirgholami
49
269
mit
10
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
hessian optimizer adahessian hessian-free second-order-optimization
Created 2020-05-24
67 commits to master branch, last one about a year ago
EmbersArc
Epigraph EmbersArc
15
155
mit
7
A C++ interface to formulate and solve linear, quadratic and second order cone problems.
qp socp eigen eigen-library quadratic-programming numerical-optimization second-order-optimization
Created 2020-06-29
98 commits to master branch, last one 3 years ago
lixilinx
psgd_torch lixilinx
8
143
unknown
7
Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)
pytorch lie-groups affine-group deep-learning preconditioner hessian-vector-product low-rank-approximation optimization-algorithms second-order-optimization stochastic-gradient-descent kronecker-factored-approximation
Created 2018-04-07
173 commits to master branch, last one 7 days ago
gpauloski
kfac-pytorch gpauloski
25
81
mit
4
Distributed K-FAC Preconditioner for PyTorch
kfac pytorch optimizer distributed deep-learning second-order-optimization
Created 2020-02-16
636 commits to main branch, last one 4 days ago
ltatzel
PyTorchHessianFree ltatzel
6
31
bsd-3-clause
4
PyTorch implementation of the Hessian-free optimizer
ggn matrix-free hessian-free deep-learning newtons-method conjugate-gradient deep-neural-networks stochastic-optimizers pytorch-implementation optimization-algorithms second-order-optimization
Created 2022-07-11
104 commits to main branch, last one 6 months ago