thu-ml / SageAttention

Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

Date Created 2024-10-03 (4 months ago)
Commits 81 (last one 4 days ago)
Stargazers 959 (15 this week)
Watchers 24 (0 this week)
Forks 59
License apache-2.0
Ranking

RepositoryStats indexes 617,630 repositories, of these thu-ml/SageAttention is ranked #54,404 (91st percentile) for total stargazers, and #93,057 for total watchers. Github reports the primary language for this repository as Cuda, for repositories using this language it is ranked #29/373.

thu-ml/SageAttention is also tagged with popular topics, for these it's ranked: llm (#514/3273),  cuda (#102/678),  video-generation (#22/161)

Other Information

thu-ml/SageAttention has 1 open pull request on Github, 10 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 29 open issues and 69 closed issues.

Star History

Github stargazers over time

1k1k9009008008007007006006005005004004003003002002001001000015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Watcher History

Github watchers over time, collection started in '23

2424222220201818161614141212101088664415 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Recent Commit History

81 commits on the default branch (main) since jan '22

9090808070706060505040403030202010100015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Yearly Commits

Commits to the default branch (main) per year

70706060505040403030202010100020242024

Issue History

Total Issues
Open Issues
Closed Issues
1001009090808070706060505040403030202010100015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Languages

The primary language is Cuda but there's also others...

CudaCudaPythonPythonC++C++CCShellShell

updated: 2025-02-19 @ 03:38pm, id: 867007699 / R_kgDOM6180w