1 result found Sort:

b4rtaz
distributed-llama b4rtaz
107
1.5k
mit
31
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
llm llms llama2 llama3 open-llm llm-inference neural-network distributed-llm distributed-computing
Created 2023-12-04
285 commits to main branch, last one 2 days ago