Search Results - RepositoryStats

11

270

mit

25

A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

grokking emergence awesome-list double-descent neural-collapse phase-transitions empirical-research deep-learning-theory neural-tangent-kernel non-convex-optimization neuroscience-inspired-ai lottery-ticket-hypothesis information-bottleneck-theory

Created 2020-06-23

381 commits to master branch, last one 18 days ago

nngeometry tfjgeorge

20

207

mit

7

{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

fim ntk gram kfac ekfac k-fac ek-fac pytorch tangent jacobian neural-tangent-kernel fisher-information-matrix

Created 2019-09-12

457 commits to master branch, last one about a month ago

trak MadryLab

25

179

mit

9

A fast, effective data attribution method for neural networks in PyTorch

pytorch attribution deep-learning machine-learning neural-tangent-kernel

Created 2023-01-27

203 commits to main branch, last one 2 days ago

dks google-deepmind

4

64

apache-2.0

5

Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural network models (and their initializations) to make them easier to tr...

jax pytorch tensorflow deep-learning neural-networks machine-learning neural-tangent-kernel artificial-intelligence

Created 2022-02-25

21 commits to main branch, last one 8 days ago

eigenlearning james-simon

8

49

unknown

6

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

eigenvalues deep-learning neural-tangents deep-learning-theory neural-tangent-kernel

Created 2021-09-22

127 commits to master branch, last one about a year ago