lucidrains / grokfast-pytorch

Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"

lucidrains
lucidrains
Date Created 2024-06-15 (9 months ago)
Commits 23 (last one 3 months ago)
Stargazers 98 (0 this week)
Watchers 3 (0 this week)
Forks 7
License mit
Ranking

RepositoryStats indexes 637,085 repositories, of these lucidrains/grokfast-pytorch is ranked #312,660 (51st percentile) for total stargazers, and #419,809 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #59,407/130,505.

lucidrains/grokfast-pytorch is also tagged with popular topics, for these it's ranked: deep-learning (#5,256/8838),  artificial-intelligence (#1,317/2289)

Other Information

lucidrains/grokfast-pytorch has Github issues enabled, there are 4 open issues and 0 closed issues.

There have been 10 releases, the latest one was published on 2024-12-22 (3 months ago) with the name 0.0.11.

Star History

Github stargazers over time

10010090908080707060605050404030302020101000Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Watcher History

Github watchers over time, collection started in '23

3333332.52.5222222Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Recent Commit History

23 commits on the default branch (main) since jan '22

25252020151510105500Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Yearly Commits

Commits to the default branch (main) per year

2525202015151010550020242024

Issue History

Total Issues
Open Issues
Closed Issues
443.53.5332.52.5221.51.5110.50.500Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-03-15 @ 03:47pm, id: 815598095 / R_kgDOMJ0KDw