Search Results - RepositoryStats

9

270

mit

24

A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

grokking emergence awesome-list double-descent neural-collapse phase-transitions empirical-research deep-learning-theory neural-tangent-kernel non-convex-optimization neuroscience-inspired-ai lottery-ticket-hypothesis information-bottleneck-theory

Created 2020-06-23

381 commits to master branch, last one 4 days ago

nngeometry tfjgeorge

20

206

mit

7

{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

fim ntk gram kfac ekfac k-fac ek-fac pytorch tangent jacobian neural-tangent-kernel fisher-information-matrix

Created 2019-09-12

457 commits to master branch, last one about a month ago

trak MadryLab

24

175

mit

9

A fast, effective data attribution method for neural networks in PyTorch

pytorch attribution deep-learning machine-learning neural-tangent-kernel

Created 2023-01-27

202 commits to main branch, last one 9 months ago

dks google-deepmind

4

64

apache-2.0

5

Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural network models (and their initializations) to make them easier to tr...

jax pytorch tensorflow deep-learning neural-networks machine-learning neural-tangent-kernel artificial-intelligence

Created 2022-02-25

20 commits to main branch, last one 3 months ago

eigenlearning james-simon

8

49

unknown

6

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

eigenvalues deep-learning neural-tangents deep-learning-theory neural-tangent-kernel

Created 2021-09-22

127 commits to master branch, last one about a year ago