10 results found Sort:

bentoml
OpenLLM bentoml
691
10.9k
apache-2.0
57
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm
Created 2023-04-19
1,871 commits to main branch, last one 24 hours ago
kennethleungty
Llama-2-Open-Source-LLM-CPU-Inference kennethleungty
214
961
mit
14
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
cpu llm nlp faiss llama python chatgpt llama-2 langchain document-qa transformers cpu-inference deep-learning c-transformers language-models open-source-llm machine-learning large-language-models sentence-transformers natural-language-processing
Created 2023-07-06
37 commits to main branch, last one about a year ago
ghimiresunil
LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing ghimiresunil
118
666
mit
17
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
bert huggingface open-source llm-training transformers llm-inference llm-tutorials open-source-llm large-language-models
Created 2023-05-28
674 commits to main branch, last one about a month ago
rohan-paul
LLM-FineTuning-Large-Language-Models rohan-paul
122
511
unknown
9
LLM (Large Language Model) FineTuning
llm gpt-3 llama2 pytorch gpt3-turbo mistral-7b llm-serving llm-training llm-inference llm-finetuning open-source-llm large-language-models
Created 2023-10-22
165 commits to main branch, last one 9 months ago
Kenza-AI
sagify Kenza-AI
69
439
mit
17
LLMs and Machine Learning done easily
llm cohere llmops openai anthropic langchain sagemaker ai-gateway generative-ai llm-inference open-source-llm langchain-python large-language-model large-language-models
Created 2018-03-03
624 commits to main branch, last one about a year ago
sozercan
aikit sozercan
35
430
mit
8
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
417 commits to main branch, last one a day ago
PetroIvaniuk
llms-tools PetroIvaniuk
27
204
apache-2.0
5
A list of LLMs Tools & Projects
ai llm chatgpt chat-bot chatbots data-science llm-evaluation open-source-llm machine-learning
Created 2023-05-09
68 commits to main branch, last one 2 days ago
ArdaGnsrn
ollama-php ArdaGnsrn
15
121
mit
3
This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexi...
llm llama llama3 ollama ollama-api ollama-php open-source-llm
Created 2024-08-13
30 commits to master branch, last one 2 months ago
SAP-samples
btp-generative-ai-hub-use-cases SAP-samples
50
45
apache-2.0
17
Samples on how to build industry solution leveraging generative AI capabilities on top of SAP BTP and integrated with SAP S/4HANA Cloud.
llm aihub genai sample vector sap-btp embeddings sample-code sap-ai-core generative-ai sap-build-code open-source-llm sap-generative-ai-hub sap-generative-ai-hub-sdk sap-hana-cloud-vector-engine
Created 2024-02-13
146 commits to main branch, last one 16 hours ago
EmbeddedLLM
embeddedllm EmbeddedLLM
1
33
unknown
2
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
cpu llm npu aipc gemma llama phi-3 ipexllm mistral windows directml openvino directx-12 llm-serving llm-inference model-inference open-source-llm openvino-inference-engine
Created 2024-06-17
41 commits to main branch, last one 5 months ago