5 results found Sort:

MinghuiChen43
awesome-deep-phenomena MinghuiChen43
8
223
mit
23
A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...
grokking emergence awesome-list double-descent neural-collapse phase-transitions empirical-research deep-learning-theory neural-tangent-kernel non-convex-optimization neuroscience-inspired-ai lottery-ticket-hypothesis information-bottleneck-theory
Created 2020-06-23
362 commits to master branch, last one 5 days ago
tfjgeorge
nngeometry tfjgeorge
20
197
mit
7
{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
fim ntk gram kfac ekfac k-fac ek-fac pytorch tangent jacobian neural-tangent-kernel fisher-information-matrix
Created 2019-09-12
448 commits to master branch, last one 4 months ago
MadryLab
trak MadryLab
21
151
mit
9
A fast, effective data attribution method for neural networks in PyTorch
pytorch attribution deep-learning machine-learning neural-tangent-kernel
Created 2023-01-27
202 commits to main branch, last one 5 months ago
google-deepmind
dks google-deepmind
2
54
apache-2.0
6
Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural network models (and their initializations) to make them easier to tr...
jax pytorch tensorflow deep-learning neural-networks machine-learning neural-tangent-kernel artificial-intelligence
Created 2022-02-25
19 commits to main branch, last one 11 days ago
james-simon
eigenlearning james-simon
8
49
unknown
6
codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
eigenvalues deep-learning neural-tangents deep-learning-theory neural-tangent-kernel
Created 2021-09-22
127 commits to master branch, last one about a year ago