4 results found Sort:

b4rtaz
distributed-llama b4rtaz
107
1.5k
mit
31
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
llm llms llama2 llama3 open-llm llm-inference neural-network distributed-llm distributed-computing
Created 2023-12-04
285 commits to main branch, last one 2 days ago
sozercan
kubectl-ai sozercan
78
1.0k
mit
14
✨ Kubectl plugin to create manifests with LLMs
ai gpt k8s llm gpt-4 openai chatgpt kubectl open-llm kubernetes localllama openai-api hacktoberfest kubectl-plugins
Created 2023-03-19
92 commits to main branch, last one 23 days ago
sozercan
aikit sozercan
29
393
mit
6
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
341 commits to main branch, last one 11 days ago
Vokturz
LLM-slackbot-channels Vokturz
3
39
mit
2
A user-customized bot for your slack channels using LLMs, Tools and Documents
llm agent open-llm slackbot langchain slack-bot slackbolt
Created 2023-06-12
184 commits to main branch, last one about a year ago