10 results found Sort:

bentoml
OpenLLM bentoml
639
10.1k
apache-2.0
56
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm
Created 2023-04-19
1,821 commits to main branch, last one 2 days ago
sgl-project
sglang sgl-project
518
6.1k
apache-2.0
58
SGLang is a fast serving framework for large language models and vision language models.
llm moe vlm cuda llama llava llama2 llama3 pytorch llama3-1 inference llm-serving transformer
Created 2024-01-08
1,267 commits to main branch, last one a day ago
EmbeddedLLM
JamAIBase EmbeddedLLM
17
426
apache-2.0
5
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...
ai llm rag baas agents python svelte chatbot chatgpt lancedb llm-ops llama3-1 workflow serverless spreadsheet orchestration ai-agents-framework backend-as-a-service intelligent-spreadsheet retrieval-augmented-generation
Created 2024-05-30
14 commits to main branch, last one a day ago
adalkiran
llama-nuts-and-bolts adalkiran
10
232
apache-2.0
6
A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.
go ml llama utf-8 golang unicode llama3-1 transformers deep-learning machine-learning educational-project large-language-models
Created 2023-12-12
88 commits to main branch, last one 3 months ago
datastax
astra-assistants-api datastax
18
163
apache-2.0
10
Drop in replacement for the OpenAI Assistants API
groq gpt-4 claude cohere gemini ollama vector llama3-1 assistants assistants-api openai-assistants openai-assistants-api
Created 2023-11-15
483 commits to main branch, last one 6 days ago
austin-starks
Promptimizer austin-starks
13
151
other
3
An Automated AI-Powered Prompt Optimization Framework
ai llm llama3 ollama openai mongodb llama3-1 llamacpp anthropic open-source optimization machine-learning genetic-algorithm prompt-management prompt-engineering large-language-model aritificial-intelligence
Created 2024-07-26
12 commits to master branch, last one 3 months ago
aimagelab
LLaVA-MORE aimagelab
6
86
apache-2.0
7
LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1
llms llava llama3 llama3-1 llava-llama3 llama3-vision multimodal-llms vision-and-language
Created 2024-07-31
18 commits to main branch, last one 2 months ago
Debapriya-source
nyaya-gpt Debapriya-source
11
54
unknown
2
AI agent with RAG+ReAct on Indian Constitution & BNS
llm rag groq llama3-1 streamlit artificial-intelligence
Created 2024-09-10
14 commits to main branch, last one 28 days ago
RMNCLDYO
perplexity-ai-toolkit RMNCLDYO
6
47
mit
5
A versatile CLI and Python wrapper for Perplexity's suite of large language models including their flagship 'Sonar' models (built on top of Meta's latest and most advanced open-source model 'Llama-3.1...
pplx llama chatbot llama-3 pplx-ai llama3-1 llama-3-1 perplexity perplexityai perplexity-ai perplexity-api perplexity-labs perplexity-sonar llama-3-1-8b-instruct llama-3-1-70b-instruct llama-3-1-sonar-large-128k-chat llama-3-1-sonar-small-128k-chat llama-3-1-sonar-huge-128k-online llama-3-1-sonar-large-128k-online llama-3-1-sonar-small-128k-online
Created 2024-01-10
154 commits to main branch, last one 3 months ago
mumu-lhl
duckduckgo-ai-chat-service mumu-lhl
33
25
mit
1
Use Duckduckgo AI Chat to provide an OpenAI-compatible API that can be used for free with gpt-4o-mini.
ai api gpt llama llama3 chatbot chatgpt llama3-1 duckduckgo openai-api gpt-4o-mini self-hosted claude-haiku claude-3-haiku
Created 2024-08-02
52 commits to main branch, last one 3 months ago