5 results found Sort:

2.2k
17.8k
other
95
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Created 2023-07-27
19,555 commits to main branch, last one 15 hours ago
84
1.7k
apache-2.0
20
AI-native (edge and LLM) proxy for agents. Handles all the pesky heavy lifting in building agentic apps -- fast ⚡️ query routing, seamless integration of prompts with business APIs, and unified acces...
Created 2024-07-09
342 commits to main branch, last one 12 hours ago
133
941
apache-2.0
24
🦄APIPark is the #1 open-source AI Gateway and Developer Portal, enabling you to easily manage, integrate, and deploy AI and API services. APIPark seamlessly connects with various large AI models and ...
Created 2024-08-12
959 commits to main branch, last one a day ago
9
72
apache-2.0
4
Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.
Created 2025-01-27
100 commits to main branch, last one 20 hours ago
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability,...
Created 2025-02-08
36 commits to main branch, last one 5 days ago