12 results found Sort:

Kong
kong Kong
4.8k
39.6k
apache-2.0
1.0k
🦍 The Cloud-Native API Gateway and AI Gateway.
ai apis kong nginx consul devops docker luajit ai-gateway kubernetes serverless api-gateway cloud-native microservice microservices reverse-proxy api-management kubernetes-ingress artificial-intelligence kubernetes-ingress-controller
Created 2014-11-17
10,993 commits to master branch, last one 18 hours ago
BerriAI
litellm BerriAI
1.8k
15.3k
other
84
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
llm llmops openai bedrock gateway anthropic langchain vertex-ai ai-gateway llm-gateway azure-openai openai-proxy
Created 2023-07-27
18,698 commits to main branch, last one 17 hours ago
Portkey-AI
gateway Portkey-AI
486
6.6k
mit
39
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
llms llmops openai router gateway langchain ai-gateway llama-index generative-ai hacktoberfest prompt-engineering
Created 2023-08-23
1,824 commits to main branch, last one 2 days ago
Calcium-Ion
new-api Calcium-Ion
911
4.1k
apache-2.0
22
AI模型接口管理与分发系统，支持将多种大模型转为OpenAI格式调用、支持Midjourney Proxy、Suno、Rerank，兼容易支付协议，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple langu...
suno claude gemini openai rerank ai-gateway midjourney
Created 2023-11-10
1,898 commits to main branch, last one 8 hours ago
alibaba
higress alibaba
541
3.7k
apache-2.0
51
🤖 AI Gateway | AI Native API Gateway
envoy ai-native ai-gateway api-gateway cloud-native
Created 2022-10-27
867 commits to main branch, last one a day ago
katanemo
archgw katanemo
47
1.0k
apache-2.0
11
Arch is an intelligent gateway for agents. Engineered with (fast) LLMs for the secure handling, rich observability, and seamless integration of prompts with your APIs - all outside business logic. Bui...
llms envoy proxy llmops openai prompt gateway routing ai-gateway envoyproxy llm-gateway llm-routing proxy-server generative-ai llm-inference
Created 2024-07-09
293 commits to main branch, last one 19 hours ago
APIParkLab
APIPark APIParkLab
99
724
apache-2.0
20
🦄APIPark is the #1 open-source AI Gateway and Developer Portal, enabling you to easily manage, integrate, and deploy AI and API services. APIPark seamlessly connects with various large AI models and ...
ai api apihub claude openai gateway openapi dashboard ai-gateway api-portal api-gateway llm-gateway api-platform api-dashboard developer-tools developerportal developer-portal
Created 2024-08-12
630 commits to main branch, last one 3 days ago
Kenza-AI
sagify Kenza-AI
69
436
mit
18
LLMs and Machine Learning done easily
llm cohere llmops openai anthropic langchain sagemaker ai-gateway generative-ai llm-inference open-source-llm langchain-python large-language-model large-language-models
Created 2018-03-03
624 commits to main branch, last one 9 months ago
Portkey-AI
portkey-python-sdk Portkey-AI
17
53
mit
4
Build reliable, secure, and production-ready AI apps easily.
llms mlops llmops portkey ai-gateway
Created 2023-08-28
616 commits to main branch, last one 10 days ago
adrianliechti
llama adrianliechti
5
35
mit
3
Inference Hub for AI at Scale
llm rag groq llama claude ollama openai mistral llamacpp ai-gateway openai-api azure-openai function-calling
Created 2023-09-07
467 commits to main branch, last one 24 hours ago
Portkey-AI
portkey-node-sdk Portkey-AI
8
29
unknown
3
Build reliable, secure, and production-ready AI apps easily.
llms mlops llmops portkey ai-gateway
Created 2023-09-18
326 commits to main branch, last one 10 days ago
MagicAPI
ai-gateway MagicAPI
3
28
apache-2.0
1
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
ai api gateway ai-gateway
Created 2024-11-07
51 commits to main branch, last one 29 days ago