7 results found Sort:

xorbitsai
inference xorbitsai
246
3.0k
apache-2.0
34
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...
llm ggml qwen vllm gemma llama llama3 chatglm flan-t5 mistral pytorch whisper chatglm3 llamacpp wizardlm inference deployment openai-api machine-learning artificial-intelligence
Created 2023-06-14
712 commits to main branch, last one a day ago
smallcloudai
refact smallcloudai
95
1.5k
bsd-3-clause
20
WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
ai chat llms llama2 devtools starchat wizardlm starcoder fine-tuning refactoring self-hosted autocompletion developer-tools
Created 2023-04-19
1,066 commits to main branch, last one 10 days ago
basetenlabs
truss basetenlabs
58
848
mit
11
The simplest way to serve AI/ML models in production
falcon whisper wizardlm packaging easy-to-use open-source inference-api model-serving inference-server machine-learning stable-diffusion artificial-intelligence
Created 2022-07-06
976 commits to main branch, last one 14 hours ago
withcatai
catai withcatai
27
416
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
188 commits to main branch, last one 18 days ago
h2oai
h2o-wizardlm h2oai
25
282
apache-2.0
66
Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning
gpt llm vicuna wizardlm opensource
Created 2023-05-12
50 commits to main branch, last one 11 months ago
abhinand5
gptq_for_langchain abhinand5
9
40
gpl-3.0
2
A guide about how to use GPTQ models with langchain
ai gpt llm gptq wizardlm langchain quantization language-model
Created 2023-05-11
8 commits to main branch, last one 9 months ago
snwfdhmp
llm snwfdhmp
7
37
other
4
Use any LLM from the command line.
llm llms gpt-3 gpt-4 llama chatgpt cli-app wizardlm bing-chat bing-chat-ai large-language-model large-language-models
Created 2023-06-08
160 commits to main branch, last one 3 months ago