1 result found Sort:

b4rtaz
distributed-llama b4rtaz
111
1.6k
mit
32
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
llm llms llama2 llama3 open-llm llm-inference neural-network distributed-llm distributed-computing
Created 2023-12-04
292 commits to main branch, last one 3 days ago