CASE-Lab-UMD / LLM-Drop

The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".

CASE-Lab-UMD
CASE-Lab-UMD
Date Created 2024-05-09 (10 months ago)
Commits 50 (last one 4 days ago)
Stargazers 165 (0 this week)
Watchers 3 (0 this week)
Forks 19
License apache-2.0
Ranking

RepositoryStats indexes 634,026 repositories, of these CASE-Lab-UMD/LLM-Drop is ranked #216,439 (66th percentile) for total stargazers, and #418,530 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #39,844/129,650.

CASE-Lab-UMD/LLM-Drop is also tagged with popular topics, for these it's ranked: deep-learning (#4,033/8821),  machine-learning (#3,815/8417),  natural-language-processing (#681/1473),  large-language-models (#571/1232),  model-compression (#55/108)

Star History

Github stargazers over time

180180160160140140120120100100808060604040202000Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Watcher History

Github watchers over time, collection started in '23

4444443.53.5333333Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Recent Commit History

50 commits on the default branch (main) since jan '22

5050454540403535303025252020151510105500Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Yearly Commits

Commits to the default branch (main) per year

505045454040353530302525202015151010550020242024

Issue History

Total Issues
Open Issues
Closed Issues
1414121210108866442200Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Languages

The primary language is Python but there's also others...

PythonPythonCudaCudaC++C++ShellShellCC

updated: 2025-03-29 @ 04:43am, id: 798128448 / R_kgDOL5J5QA