6 results found Sort:

xorbitsai
inference xorbitsai
606
7.4k
apache-2.0
54
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...
llm ggml glm4 qwen vllm gemma llama llama3 chatglm flan-t5 mistral pytorch whisper llamacpp wizardlm inference deployment openai-api machine-learning artificial-intelligence
Created 2023-06-14
1,152 commits to main branch, last one 3 hours ago
basetenlabs
truss basetenlabs
84
972
mit
19
The simplest way to serve AI/ML models in production
falcon whisper wizardlm packaging easy-to-use open-source inference-api model-serving inference-server machine-learning stable-diffusion artificial-intelligence
Created 2022-07-06
1,567 commits to main branch, last one 14 hours ago
withcatai
catai withcatai
33
471
mit
9
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 9 months ago
h2oai
h2o-wizardlm h2oai
29
303
apache-2.0
63
Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning
gpt llm vicuna wizardlm opensource
Created 2023-05-12
50 commits to main branch, last one about a year ago
snwfdhmp
llm snwfdhmp
8
56
other
4
Use any LLM from the command line.
llm llms gpt-3 gpt-4 llama chatgpt cli-app wizardlm bing-chat bing-chat-ai large-language-model large-language-models
Created 2023-06-08
160 commits to main branch, last one about a year ago
abhinand5
gptq_for_langchain abhinand5
9
40
gpl-3.0
2
A guide about how to use GPTQ models with langchain
ai gpt llm gptq wizardlm langchain quantization language-model
Created 2023-05-11
8 commits to main branch, last one about a year ago