7 results found Sort:

bentoml
OpenLLM bentoml
575
9.0k
apache-2.0
52
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
ai ml llm mpt llama mlops falcon llama2 llmops vicuna bentoml llm-ops mistral openllm stablelm fine-tuning llm-serving llm-inference model-inference open-source-llm
Created 2023-04-19
1,521 commits to main branch, last one a day ago
kennethleungty
Llama-2-Open-Source-LLM-CPU-Inference kennethleungty
205
933
mit
13
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
cpu llm nlp faiss llama python chatgpt llama-2 langchain document-qa transformers cpu-inference deep-learning c-transformers language-models open-source-llm machine-learning large-language-models sentence-transformers natural-language-processing
Created 2023-07-06
37 commits to main branch, last one 6 months ago
ghimiresunil
LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing ghimiresunil
90
505
mit
14
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
bert huggingface open-source llm-training transformers llm-inference llm-tutorials open-source-llm large-language-models
Created 2023-05-28
615 commits to main branch, last one 2 days ago
Kenza-AI
sagify Kenza-AI
70
430
mit
18
LLMs and Machine Learning done easily
llm cohere llmops openai anthropic langchain sagemaker ai-gateway generative-ai llm-inference open-source-llm langchain-python large-language-model large-language-models
Created 2018-03-03
624 commits to main branch, last one 2 months ago
rohan-paul
LLM-FineTuning-Large-Language-Models rohan-paul
81
372
unknown
8
LLM (Large Language Model) FineTuning
llm gpt-3 llama2 pytorch gpt3-turbo mistral-7b llm-serving llm-training llm-inference llm-finetuning open-source-llm large-language-models
Created 2023-10-22
165 commits to main branch, last one 12 days ago
sozercan
aikit sozercan
21
238
mit
3
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
217 commits to main branch, last one 16 hours ago
PetroIvaniuk
llms-tools PetroIvaniuk
13
68
apache-2.0
2
A list of LLMs Tools & Projects
ai llm chatgpt chat-bot chatbots data-science llm-evaluation open-source-llm machine-learning
Created 2023-05-09
47 commits to main branch, last one 13 days ago