ModelTC / llmc

This is the official implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and it is also an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.

Date Created 2024-03-06 (2 months ago)

Commits 38 (last one a day ago)

Stargazers 86 (7 this week)

Watchers 8 (0 this week)

Forks 8

License apache-2.0

Ranking

RepositoryStats indexes 523,840 repositories, of these ModelTC/llmc is ranked #296,626 (43rd percentile) for total stargazers, and #234,250 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #53,633/100,813.

ModelTC/llmc is also tagged with popular topics, for these it's ranked: llm (#1,149/1875), tool (#554/870), large-language-models (#514/795), benchmark (#414/644), deployment (#290/413)

Other Information

ModelTC/llmc has Github issues enabled, there are 2 open issues and 1 closed issue.

Homepage URL: https://arxiv.org/abs/2405.06001

All Topics

llm tool pruning benchmark deployment evaluation quantization large-language-models

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

38 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Python but there's also others...

updated: 2024-05-31 @ 06:45pm, id: 768146998 / R_kgDOLcj-Ng