5 results found Sort:

MinghuiChen43
awesome-deep-phenomena MinghuiChen43
12
305
mit
25
A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...
grokking emergence awesome-list double-descent neural-collapse phase-transitions empirical-research deep-learning-theory neural-tangent-kernel non-convex-optimization neuroscience-inspired-ai lottery-ticket-hypothesis information-bottleneck-theory
Created 2020-06-23
388 commits to master branch, last one 3 days ago
tfjgeorge
nngeometry tfjgeorge
22
211
mit
6
{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
fim ntk gram kfac ekfac k-fac ek-fac hessian pytorch tangent jacobian neural-tangent-kernel fisher-information-matrix
Created 2019-09-12
500 commits to master branch, last one 10 days ago
MadryLab
trak MadryLab
26
201
mit
9
A fast, effective data attribution method for neural networks in PyTorch
pytorch attribution deep-learning machine-learning neural-tangent-kernel
Created 2023-01-27
203 commits to main branch, last one 4 months ago
google-deepmind
dks google-deepmind
5
67
apache-2.0
4
Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural network models (and their initializations) to make them easier to tr...
jax pytorch tensorflow deep-learning neural-networks machine-learning neural-tangent-kernel artificial-intelligence
Created 2022-02-25
22 commits to main branch, last one 3 months ago
james-simon
eigenlearning james-simon
8
50
unknown
5
codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
eigenvalues deep-learning neural-tangents deep-learning-theory neural-tangent-kernel
Created 2021-09-22
127 commits to master branch, last one about a year ago