🦍 The API and AI Gateway

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI.

Consul is a distributed, highly available, and data center aware solution to connect and configure applications across dynamic, distributed infrastructure.

SafeLine is a self-hosted WAF(Web Application Firewall) / reverse proxy to protect your web apps from attacks and exploits.

The Cloud-Native API Gateway and AI Gateway

Serverless Python

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Tyk Open Source API Gateway written in Go, supporting REST, GraphQL, TCP and gRPC protocols

Deploy infinitely scalable serverless apps, apis, and sites in seconds to AWS.

Apache ShenYu is a Java native API Gateway for service proxy, protocol conversion and API governance.

.NET API Gateway

🤖 AI Gateway | AI Native API Gateway

Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation

CLI tool to build, test, debug, and deploy Serverless applications using AWS SAM

A Cloud Native traffic orchestration system

The Cloud-Native API Gateway and AI Gateway

Run Express and other Node.js frameworks on AWS Serverless technologies such as Lambda, API Gateway, Lambda@Edge, and more.

Emulate AWS λ and API Gateway locally when developing your Serverless project

Microservices from Design to Deployment 中文版 《微服务：从设计到部署》

An API Gateway built on Spring Framework and Spring Boot providing routing and more.

open source Kubernetes-native API gateway for microservices built on the Envoy Proxy

⚡ Deploy your Next.js apps on AWS Lambda@Edge via Serverless Components

The SMS Gateway for Android™ app enables sending and receiving SMS messages through an API that can be accessed directly on the device or via a cloud server when direct device access is not possible.

Deploy Node.js projects to AWS Lambda and API Gateway easily

A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.

Serverless Python

A cloud native Identity & Access Proxy / API (IAP) and Access Control Decision API that authenticates, authorizes, and mutates incoming HTTP(s) requests. Inspired by the BeyondCorp / Zero Trust white paper. Written in Go.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Reusable, vendor-neutral, industry-specific, vendor-specific solution architecture patterns for enterprise