lucidrains / native-sparse-attention-pytorch

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

lucidrains
lucidrains
Date Created 2025-02-19 (about a month ago)
Commits 209 (last one 17 days ago)
Stargazers 586 (3 this week)
Watchers 6 (0 this week)
Forks 29
License mit
Ranking

RepositoryStats indexes 638,211 repositories, of these lucidrains/native-sparse-attention-pytorch is ranked #84,606 (87th percentile) for total stargazers, and #290,924 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #14,079/130,822.

lucidrains/native-sparse-attention-pytorch is also tagged with popular topics, for these it's ranked: deep-learning (#1,923/8850),  artificial-intelligence (#489/2293)

Other Information

lucidrains/native-sparse-attention-pytorch has Github issues enabled, there are 7 open issues and 10 closed issues.

There have been 99 releases, the latest one was published on 2025-03-25 (19 days ago) with the name 0.2.0.

Star History

Github stargazers over time

6006005005004004003003002002001001000024 Feb24 FebMar '25Mar '2508 Mar08 Mar16 Mar16 Mar24 Mar24 MarApr '25Apr '2508 Apr08 Apr

Watcher History

Github watchers over time, collection started in '23

665.55.5554.54.5443.53.53324 Feb24 FebMar '25Mar '2508 Mar08 Mar16 Mar16 Mar24 Mar24 MarApr '25Apr '2508 Apr08 Apr

Recent Commit History

209 commits on the default branch (main) since jan '22

25025020020015015010010050500024 Feb24 FebMar '25Mar '2508 Mar08 Mar16 Mar16 Mar24 Mar24 MarApr '25Apr '2508 Apr08 Apr

Yearly Commits

Commits to the default branch (main) per year

2222111111000020242024

Issue History

Total Issues
Open Issues
Closed Issues
18181616141412121010886644220024 Feb24 FebMar '25Mar '2508 Mar08 Mar16 Mar16 Mar24 Mar24 MarApr '25Apr '2508 Apr08 Apr

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-04-12 @ 11:15pm, id: 935189543 / R_kgDON73cJw