lucidrains / ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

lucidrains
lucidrains
Date Created 2024-02-14 (about a year ago)
Commits 221 (last one 5 months ago)
Stargazers 510 (1 this week)
Watchers 11 (0 this week)
Forks 30
License mit
Ranking

RepositoryStats indexes 637,706 repositories, of these lucidrains/ring-attention-pytorch is ranked #94,127 (85th percentile) for total stargazers, and #186,703 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #15,938/130,682.

Other Information

lucidrains/ring-attention-pytorch has Github issues enabled, there are 4 open issues and 13 closed issues.

There have been 124 releases, the latest one was published on 2024-10-25 (5 months ago) with the name 0.5.19.

Star History

Github stargazers over time

60060050050040040030030020020010010000Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Watcher History

Github watchers over time, collection started in '23

11111010998877665544332211Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Recent Commit History

221 commits on the default branch (main) since jan '22

250250200200150150100100505000Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Yearly Commits

Commits to the default branch (main) per year

25025020020015015010010050500020242024

Issue History

Total Issues
Open Issues
Closed Issues
181816161414121210108866442200Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-04-08 @ 06:01pm, id: 757458337 / R_kgDOLSXloQ