Lizonghang / TPI-LLM

TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices

Lizonghang
Lizonghang
Date Created 2024-08-20 (7 months ago)
Commits 139 (last one 4 months ago)
Stargazers 171 (0 this week)
Watchers 1 (0 this week)
Forks 12
License apache-2.0
Ranking

RepositoryStats indexes 629,376 repositories, of these Lizonghang/TPI-LLM is ranked #209,934 (67th percentile) for total stargazers, and #555,026 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #38,448/128,345.

Lizonghang/TPI-LLM is also tagged with popular topics, for these it's ranked: llm-inference (#94/199)

Other Information

Lizonghang/TPI-LLM has Github issues enabled, there is 1 open issue and 4 closed issues.

Star History

Github stargazers over time

180180160160140140120120100100808060604040202000Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Watcher History

Github watchers over time, collection started in '23

2222111111000015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Recent Commit History

139 commits on the default branch (main) since jan '22

140140120120100100808060604040202000Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Yearly Commits

Commits to the default branch (main) per year

14014012012010010080806060404020200020242024

Issue History

Total Issues
Open Issues
Closed Issues
554.54.5443.53.5332.52.5221.51.5110.50.50015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Languages

The primary language is Python but there's also others...

PythonPythonShellShellDockerfileDockerfile

updated: 2025-03-07 @ 04:46pm, id: 844944893 / R_kgDOMlzV_Q