4 results found Sort:

b4rtaz
distributed-llama b4rtaz
111
1.6k
mit
32
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
llm llms llama2 llama3 open-llm llm-inference neural-network distributed-llm distributed-computing
Created 2023-12-04
292 commits to main branch, last one 3 days ago
sozercan
kubectl-ai sozercan
79
1.0k
mit
14
✨ Kubectl plugin to create manifests with LLMs
ai gpt k8s llm gpt-4 openai chatgpt kubectl open-llm kubernetes localllama openai-api hacktoberfest kubectl-plugins
Created 2023-03-19
92 commits to main branch, last one about a month ago
sozercan
aikit sozercan
31
405
mit
8
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
374 commits to main branch, last one 9 days ago
Vokturz
LLM-slackbot-channels Vokturz
3
39
mit
2
A user-customized bot for your slack channels using LLMs, Tools and Documents
llm agent open-llm slackbot langchain slack-bot slackbolt
Created 2023-06-12
184 commits to main branch, last one about a year ago