bestofgithub.dev

← Back to the directory

Portkey-AI/gateway

View on GitHub

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Portkey-AI/gateway is #2,584 on the bestofgithub Elo ladder, in Platinum III, with a rating of 1,668 (+18 this week). It has 13,384 stars, 39 gained in the last week.

Platinum III

1,668 Elo

  • #2,584 on the ladder
  • +1 today · +18 this week
  • Peak 1,675
28 Elo to Platinum II

Stars

13,384

  • +5 today
  • +39 this week
  • – this month

Repository

Forks
1.3k
Language
TypeScript
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/Portkey-AI/gateway.svg?style=card)](https://bestofgithub.dev/repo/Portkey-AI/gateway)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/Portkey-AI/gateway.svg)](https://bestofgithub.dev/repo/Portkey-AI/gateway)

Install

git
git clone https://github.com/Portkey-AI/gateway.git

Similar repositories

BerriAI/litellm

Open on GitHubPython

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

  • 2,138−6 Elo, change today
  • 63.3k stars
  • 13.3k forks
  • 237 watchers
git
git clone https://github.com/BerriAI/litellm.git
v1.109.13d ago
  • ai-gateway
  • anthropic
  • azure-openai
  • bedrock

langfuse/langfuse

Open on GitHubTypeScript

🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

  • 2,017−6 Elo, change today
  • 37.4k stars
  • 4.2k forks
  • 111 watchers
docker
git clone https://github.com/langfuse/langfuse && cd langfuse && docker compose up -d
v4.80.02d ago
  • ai-gateway
  • analytics
  • evaluation
  • gateway

modelcontextprotocol/registry

Open on GitHubGo

A community driven registry service for Model Context Protocol (MCP) servers.

  • 1,502−1 Elo, change today
  • 7.4k stars
  • 1k forks
git
git clone https://github.com/modelcontextprotocol/registry.git
  • mcp
  • mcp-servers

katanemo/plano

Open on GitHubRust

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

  • 1,374+2 Elo, change today
  • 7.1k stars
  • 498 forks
git
git clone https://github.com/katanemo/plano.git
  • ai-gateway
  • ai-gateway-support
  • envoy
  • envoyproxy

maximhq/bifrost

Open on GitHubGo

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

  • 1,804+8 Elo, change today
  • 9.5k stars
  • 1.5k forks
  • 35 watchers
git
git clone https://github.com/maximhq/bifrost.git
ent-v2.5.1-base5d ago
  • agent-gateway
  • ai-gateway
  • ai-governance
  • api-gateway

README

Loading README…