b4rtaz / distributed-llama

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

b4rtaz
b4rtaz
Date Created 2023-12-04 (about a year ago)
Commits 332 (last one 3 days ago)
Stargazers 2,001 (2 this week)
Watchers 40 (0 this week)
Forks 143
License mit
Ranking

RepositoryStats indexes 635,084 repositories, of these b4rtaz/distributed-llama is ranked #26,946 (96th percentile) for total stargazers, and #53,197 for total watchers. Github reports the primary language for this repository as C++, for repositories using this language it is ranked #1,426/33,890.

b4rtaz/distributed-llama is also tagged with popular topics, for these it's ranked: llm (#362/3619),  neural-network (#139/1138),  llms (#75/697),  llama2 (#32/242),  llm-inference (#26/202),  distributed-computing (#16/198),  llama3 (#28/192)

Other Information

b4rtaz/distributed-llama has Github issues enabled, there are 28 open issues and 62 closed issues.

There have been 42 releases, the latest one was published on 2025-04-01 (3 days ago) with the name 0.13.2.

Star History

Github stargazers over time

2.5k2.5k2k2k1.5k1.5k1k1k50050000Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Watcher History

Github watchers over time, collection started in '23

40403535303025252020151510105500Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Recent Commit History

332 commits on the default branch (main) since jan '22

35035030030025025020020015015010010050500020242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25Apr '25Apr '25

Yearly Commits

Commits to the default branch (main) per year

25025020020015015010010050500020242024

Issue History

Total Issues
Open Issues
Closed Issues
90908080707060605050404030302020101000Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Languages

The primary language is C++ but there's also others...

C++C++PythonPythonMakefileMakefileCC
Opengraph Image
b4rtaz/distributed-llama

updated: 2025-04-04 @ 12:29am, id: 727470807 / R_kgDOK1xS1w