5 results found Sort:

moritztng
fltr moritztng
6
346
mit
6
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
cli llm grep rust llama llama-2 mistral mixtral grep-like localllama mixtral-8x7b operating-system
Created 2023-12-06
92 commits to main branch, last one 2 months ago
sozercan
aikit sozercan
21
238
mit
3
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
217 commits to main branch, last one 14 hours ago
SqueezeAILab
KVQuant SqueezeAILab
16
217
unknown
14
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
llm llama mistral localllm localllama compression transformer quantization small-models efficient-model text-generation model-compression efficient-inference large-language-models natural-language-processing
Created 2024-01-31
10 commits to main branch, last one about a month ago
BrutalCoding
aub.ai BrutalCoding
14
168
agpl-3.0
10
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
ios nlp dart genai linux macos gemini gen-ai ipados pubdev android flutter indiedev llamacpp on-device localllama mistral-7b gemini-nano native-apps on-device-ai
Created 2023-12-04
33 commits to main branch, last one 4 months ago
poloclub
wordflow poloclub
21
151
mit
7
Social and customizable AI writing assistant! ✍️
ai gpt llm mlc gpt-4 gemini llama2 gemini-pro localllama writing-assistant prompt-engineering
Created 2023-10-24
235 commits to main branch, last one about a month ago