cheaper-inference/OmniRoute

Maintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/cheaper-inference/OmniRoute.svg?style=card)](https://bestofgithub.dev/repo/cheaper-inference/OmniRoute)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/cheaper-inference/OmniRoute.svg)](https://bestofgithub.dev/repo/cheaper-inference/OmniRoute)

Loading README…

	v3.8.50	v3.8.51	`v3.8.53+`
🌐 Providers	352	358	377
🧠 Unique chat model IDs	1320	1374	1475
🖼️ Modality Bridge	🆕 vision + audio + video	✓	✓
📡 Radar free catalog	🆕 opt-in	✓	✓
⚖️ Quota-aware scheduling	🆕 Quota-Share	✓	✓
📊 Quota telemetry	🆕 live	✓	✓
🧰 Headless mode	—	—	🆕 `serve --headless`
🛤️ LTS rail infra	—	—	🆕 release channels
🔎 Model discovery API	—	—	🆕 `/v1/models/query`

🚀 Start	🚀 Quick Start	📦 Install	🆓 Connect a provider
💡 Learn	💥 The Promise	🤔 Why OmniRoute	🏆 What Sets Apart
⚙️ Features	🎯 Combos	🌐 Providers	🔌 CLI & MCP
	🗜️ Compression	🖥️ Where It Runs	🔒 Private
👀 See it	🎬 In Action	✨ What's New	🤖 Compatible CLIs
💚 Support	💚 Support / Donate	💬 Community	💖 Sponsors
📦 Project	🛠️ Tech Stack	📖 Docs	👥 Contributors

Model ID	What it optimizes for
`auto`	🎯 Balanced default (LKGP — sticks to your last good provider)
`auto/coding`	🧑‍💻 Quality-first weights for code generation
`auto/fast`	⚡ Lowest latency first
`auto/cheap`	💰 Cheapest per token first
`auto/subscription`	🎟️ Only the subscription quota you already pay for — fails closed, never a billable fallback (guide)
`auto/thrifty`	🪜 Plan quota first, then one rung at a time to the cheapest paid options — back on the plan after it resets (guide)
`auto/offline`	🔋 Most quota / rate-limit headroom first
`auto/smart`	🔭 Quality-first + 10% exploration to discover better models
`auto/lkgp`	📌 Explicit last-known-good-provider stickiness
`auto/chaos`	🧪 Parallel fan-out to a panel of models (one per provider, 5 by default), returns one answer; one upstream call per panel model, not fault injection

#	Strategy	What it does
1	`priority`	First-target ordered list — drain each before the next 🥇
2	`fill-first`	Fill each target's quota fully before moving on
3	`weighted`	Weighted random by per-target weight
4	`round-robin`	Cycle through targets in order
5	`p2c`	Power-of-two-choices random load balancing
6	`least-used`	Pick the target with the lowest current load
7	`random`	Uniform random pick (deduplicated)
8	`strict-random`	Random without de-duplicating repeats 🎲
9	`cost-optimized`	Minimize $ per request from live catalog pricing 💸
10	`headroom`	Pick the target with the most remaining quota
11	`quota-weighted`	Skip exhausted accounts, then draw in proportion to leftover quota ÷ in-flight load — existing conversations stay pinned ⚖️
12	`reset-window`	Prefer the target whose quota window resets soonest
13	`reset-aware`	Rank by quota reset time — short windows first 📊
14	`context-relay`	Hand off context across targets for long conversations 🧠
15	`context-optimized`	Pick the best fit for the current context size
16	`cache-optimized`	Pin each reusable prompt prefix to the same account — maximize prompt-cache hits 🎯
17	`lkgp`	Last-Known-Good Path — pins to the last successful provider, then falls back to rules
18	`auto`	16-factor live scoring across every connection 🤖
19	`fusion`	Fan out to a panel of models + a judge synthesizes one answer 🧬
20	`pipeline`	Chain steps — each target's output feeds the next one 🔗

⭐ Star the repo	Free — genuinely helps visibility	Star OmniRoute
🐙 GitHub Sponsors	One-off or monthly · zero platform fee	github.com/sponsors/diegosouzapw
☕ Ko-fi	Quick one-off tip, no signup for the donor	ko-fi.com/diegosouzapw
🧋 Buy Me a Coffee	Small, informal gesture	buymeacoffee.com/diegosouzapw
🖐 Liberapay	Recurring · non-profit · open source	liberapay.com/diegosouzapw
🇧🇷 PIX (Brazil)	Instant, no fees	key & QR below
₿ Crypto	BTC · ETH · USDT-TRC20 · USDC-Solana	addresses below

₿ BTC	Bitcoin (SegWit)	`bc1qh00smz004sy85wyl28v77tenkt3ckl6eaep7fd`
Ξ ETH	Ethereum (ERC20)	`0x64Cf6B68A6Ff34288e89172950a2d00102337a84`
₮ USDT	Tron (TRC20)	`TKAF41JpuQrHbKTnsQa9svJE2T192Hvsc2`
$ USDC	Solana	`2emNNZzVVWQc3FQ2wk9M6qXUQmW8AKdjjL174fXR28Tu`

_{Claude Code}	_{Codex CLI}	_Cline	_{Kilo Code}	_{Zoo Code}	_Continue
_Aider	_ForgeCode	_jcode	_{DeepSeek TUI}	_CodeWhale	_OpenCode
_{Factory Droid}	_{Copilot CLI}	_{Cursor CLI}	_Smelt	_Pi	_{Grok Build}
_{Hermes Agent}	_OpenClaw	_Goose	_{Open Interpreter}	_{Warp AI}	_deyin.ai

_OpenAI	_Anthropic	_Gemini	_{xAI Grok}	_DeepSeek	_Mistral
_Qwen	_{Meta Llama}	_Groq	_NVIDIA	_MiniMax	_Cohere
_Perplexity	_HuggingFace	_Together	_Fireworks	_Cloudflare	_Baidu

OpenCode Zen _{DeepSeek V4, Nemotron 3 No token cap}	Kilo Code _{Auto-router, Tencent Hy3 Free forever}	Requesty _{GPT-OSS 120B, Nemotron Free forever}	SiliconFlow _{DeepSeek V3.2 / R1 Free tier}	Z.AI GLM _{GLM-4.7 / 4.5-Flash Free forever}	Baidu ERNIE _{ERNIE 4.0 Free forever}
Qoder AI _{Qwen3-Max, Kimi-K2 Unlimited FREE}	Pollinations _{GPT, Llama, Claude No key needed}	Cloudflare AI _{50+ models 10K neurons/day}	NVIDIA NIM _{GLM, MiniMax ~40 RPM free}	Cerebras _{GLM 4.7, GPT-OSS One-time $5 credit; card required}	OpenRouter _{:free models +$10 → higher RPM}

Platform	Install	Highlights
📦 npm (global)	`npm install -g omniroute`	One command, any OS
⚡ Bun (global)	`bun add -g omniroute`	Same registry tarball, faster installs
🐳 Docker	`docker run … diegosouzapw/omniroute`	Multi-arch AMD64 + ARM64
🖥️ Desktop (Electron)	`npm run electron:build`	Native window + system tray — Windows / macOS / Linux
🎩 Menu-bar (OmniRouteTray)	`brew install --cask zoispag/tap/omniroute-tray`	Supervises & auto-updates the server — macOS
💪 ARM	native `arm64`	Raspberry Pi, ARM servers, Apple Silicon
📱 Android (Termux)	`pkg install nodejs && npx -y omniroute`	Runs on your phone, 24/7, no root
📲 PWA	"Add to Home Screen"	Fullscreen, offline, installable from browser
🧩 OpenCode plugin	`@omniroute/opencode-provider`	Native OpenCode integration
🤖 VS Code Copilot Chat	install OmniCopilot extension	Every OmniRoute model in the native Copilot Chat picker — stable & Insiders
🛠️ From source	`npm install && npm run dev`	Hack on it, contribute

Store	Link	Works with
🧩 VS Code Marketplace	Install →	VS Code — stable & Insiders
🔓 Open VSX Registry	Install →	Cursor, Windsurf, VSCodium, Theia, code-server, Gitpod, Antigravity, Kiro…

What it does	How
🟢 Supervises the server	Spawns `omniroute serve`, adopts an already-running instance instead of duplicating it
📊 Live usage at a glance	Provider quota bars, Claude session/weekly limits with reset countdowns, 30-day cost breakdown
🔄 Auto-updates in place	Staged install, atomic swap, rollback on failure — always on the newest release
🚀 Start on login	Optional launch at login; tray-only, no dock icon
🩺 Doctor & logs	One-click diagnostics and server log access

Interface	Endpoint / command	Use it for
🧰 MCP (stdio)	`omniroute --mcp`	Plug into Claude Desktop, Cursor, any MCP client
🌊 MCP (HTTP)	`/api/mcp/stream`	Remote MCP — 110 tools, 33 scopes (enforcement opt-in), full audit trail
📡 MCP (SSE)	`/api/mcp/sse`	Streaming MCP transport
🤝 A2A	`/.well-known/agent.json`	Agent-to-agent, JSON-RPC 2.0 + SSE, 6 skills
🌐 REST API	`/v1/*`	OpenAI-compatible — chat, embeddings, images, audio, OCR
🔔 Webhooks	`/api/webhooks`	Push request / quota events to Slack, Discord, Telegram or any URL
🛰️ Remote CLI	`omniroute connect`	Drive a remote instance with scoped access tokens

#	Engine	What it does
1	Session-Dedup	Drops content repeated across turns (content-addressed, cross-turn)
2	CCR	Archives large blocks behind retrieve markers, fetched on demand
3	Lite	Whitespace + image-URL trimming (latency-light baseline)
4	RTK	Smart tool-result filtering, dedup & truncation (command-aware)
5	Responses Tool Output	Lossless-first JSON + bounded diagnostic compression for shell/patch/search/build outputs (Responses API)
6	Headroom	Lossless tabular compaction of JSON arrays (~30%) via a vendored GCF codec
7	Relevance	Extractive sentence scoring against the last user query
8	Caveman	Rule-based prose compression (~65–75% on output)
9	Aggressive	Summarization + progressive aging of old turns
10	LLMLingua-2	ML semantic pruning via MobileBERT ONNX — code-safe, async
11	Ultra	Heuristic token pruning with an optional small-model (SLM) tier
12	OmniGlyph	Experimental context-as-image encoding for measured Claude Fable 5 on the direct Anthropic wire; GPT 5.6 transformers remain fail-closed pending provider receipts. Four compression profiles (aggressive default, balanced, coding-safe, passthrough) (most aggressive; opt-in)

Mode	Savings	Best for
🪶 Lite	~15%	Always-on safe default
🪨 Standard (Caveman)	~30%	Daily coding
⚡ Aggressive	~50%	Long tool-heavy sessions
🔥 Ultra	~75%	Maximum savings
🧰 RTK	60–90%	Shell/test/build/git output
🔗 Stacked (RTK → Caveman)	78–95%	Mixed prompts + tool logs

Workload	Heap (`-e OMNIROUTE_MEMORY_MB`)	Container (`--memory`)
Dashboard / light chat	`1024` (image default)	≥2 g
One coding agent	`8192`	≥10 g
Two concurrent long `/v1/responses`	`10240`–`12288`	≥12–16 g

Channel	Where / how
💼 LinkedIn — follow the maintainer	linkedin.com/in/diegosouzapw
🐙 GitHub — follow for releases & tips	@diegosouzapw
💬 Discord	discord.gg/U47eFqAXCn
✈️ Telegram	t.me/omnirouteOficial
🟢 WhatsApp — 🌍 Global	join the group
🟢 WhatsApp — 🇧🇷 Brasil	entrar no grupo
🌍 Website	omniroute.online
🌍 🌍StHub OmniRoute Community (free)	portal sthub
📦 Source code	github.com/diegosouzapw/OmniRoute
🐛 Report a bug	open an issue — attach `npm run system-info` output
🤝 Contribute	CONTRIBUTING.md · Branching & Release Model · pick a `good first issue`
💚 Support the project	Ways to support ↑ · GitHub Sponsors

Layer	Technology
Runtime	Node.js 22.x / 24.x LTS — `>=22.22.2 <23 \|\| >=24.0.0 <27`
Language	TypeScript 6.0 — 100% TypeScript across `src/` and `open-sse/` (zero `any` in core since v2.0)
Framework	Next.js 16 + React 19 + Tailwind CSS 4
Database	better-sqlite3 (SQLite, WAL journaling) + LowDB (JSON legacy) — 147 domain modules, 213 migrations
Memory	SQLite FTS5 full-text + int8-quantized vector embeddings, typed decay
Schemas	Zod 4 — MCP tool I/O validation + API contracts
Protocols	MCP (stdio / HTTP / SSE) + A2A v0.3 (JSON-RPC 2.0 + SSE)
Streaming	Server-Sent Events (SSE) + WebSocket bridge (`/v1/ws`)
Compression	12-engine pipeline — RTK, Caveman, LLMLingua-2 (MobileBERT ONNX), GCF, OmniGlyph
Auth & security	OAuth 2.0 (PKCE) + JWT + API Keys + MCP scoped auth · AES-256-GCM at rest · DOMPurify
Stealth	wreq-js — JA3 / JA4 TLS fingerprint impersonation, 3-level proxy
Resilience	Circuit breaker, exponential backoff, anti-thundering-herd, auto-combo self-healing
Logging	pino — structured JSON logs with request context
Testing	Node.js test runner + Vitest — 56,000+ static test declarations across 7,800+ tracked test files (unit, integration, E2E, security, ecosystem)
Platforms	Desktop (Electron) · Android (Termux) · PWA (any browser)
CI/CD	GitHub Actions — auto npm publish + Docker Hub on release
Links	Website · npm · Docker Hub

Document	Description
User Guide	Providers, combos, CLI integration, deployment
Setup Guide	Full install methods, CLI tool configs, protocol setup, timeout tuning
CLI Tools Guide	Per-tool setup for Claude Code, Codex, Cursor, Cline, OpenClaw, Kilo, Copilot
Remote Mode	Drive a remote OmniRoute (VPS) from your laptop CLI via scoped access tokens
Claude Code Config	Point Claude Code at OmniRoute (local/remote) with `launch` + per-model profiles
Quick Start	3-step install → connect → configure

Document	Description
Docker Guide	Docker run, Compose profiles, Caddy HTTPS, tunnels, image tags
Podman Guide	Quadlet systemd integration, podman-compose, SELinux
VM Deployment	Complete guide: VM + nginx + Cloudflare setup
Fly.io Deployment	Deploy to Fly.io with persistent storage
Termux Guide	Run OmniRoute on Android via Termux
PWA Guide	Progressive Web App install, caching, architecture
Uninstall Guide	Clean removal for all install methods
Environment Config	Complete `.env` variables and references

Document	Description
Architecture	System architecture, data flow, and internals
Compression Guide	7-option pipeline: off / lite / standard / aggressive / ultra / RTK / stacked
RTK Compression	Command-output compression, filters, trust, verify, raw-output recovery
Compression Engines	Caveman, RTK, stacked pipelines, dashboard/API/MCP surfaces
Compression Rules Format	JSON rule-pack schemas for Caveman and RTK filters
Compression Language Packs	Language detection and Caveman rule-pack authoring
Resilience Guide	Circuit breakers, cooldowns, queue, anti-thundering herd, TLS spoofing
Auto-Combo Engine	16-factor scoring, mode packs, self-healing
Proxy Guide	3-level proxy system, 1proxy marketplace, registry CRUD
Free Tiers	Consolidated directory: 34 documented recurring pools / 484 cataloged free-tier entries
Features Gallery	Visual dashboard tour with screenshots
Codebase Documentation	Beginner-friendly codebase walkthrough

Document	Description
API Reference	All endpoints with examples
OpenAPI Spec	OpenAPI 3.0 specification
MCP Server	110 MCP tools, IDE configs, Python/TS/Go clients
MCP Server Guide	MCP installation, transports, and tool reference
A2A Server	JSON-RPC 2.0 protocol, skills, streaming, task mgmt
A2A Server Guide	A2A agent card, tasks, skills, and streaming

Document	Description
Contributing	Development setup and guidelines
Branching & Release Model	Where PRs target (`release/*`), what `main` and tags mean
Changelog	Full per-version release history
Security Policy	Vulnerability reporting and security practices
i18n Guide	67-language support, translation workflow, RTL
Release Checklist	Pre-release validation steps
Coverage Plan	Test coverage strategy for 56,000+ static test declarations across 7,800+ tracked test files

Rank	Contributor	Merged PRs	~Changed lines
1	maxmad64bis	371	25,326,561
2	HouMinXi	269	13,456,272
3	backryun	210	270,562
4	oyi77	190	411,243
5	pacocartones	174	78,276
6	JxnLexn	151	3,562,936
6	KooshaPari	151	5,972,314
8	rdself	145	80,663
9	RaviTharuma	123	500,065
10	herjarsa	88	230,872
11	hartmark	84	2,849,554
12	jonlwheat2-gif	67	68,548
13	artickc	62	43,502
14	chirag127	52	6,661
15	xz-dev	50	245,976
16	xiaoyaner0201	47	33,626
17	woodsonl	46	809,391
18	rqzbeh	44	147,896
19	QuangBlue	43	13,112
20	MumuTW	40	26,093

Dizzle _{🥇 367 GitHub-attributed commits}	Bob.Hou _{🥈 269 GitHub-attributed commits}	Paijo _{🥉 229 GitHub-attributed commits}	backryun _{🏅 202 GitHub-attributed commits}	Paco Cartones _{🏅 174 GitHub-attributed commits}	Ravi Tharuma _{🏅 126 GitHub-attributed commits}
Markus Hartung _{🏅 114 GitHub-attributed commits}	Randi _{🏅 108 GitHub-attributed commits}	Jan Leon _{🏅 87 GitHub-attributed commits}	Chris _{🏅 70 GitHub-attributed commits}	Koosha Paridehpour _{🏅 68 GitHub-attributed commits}

Andrew _{💛 Active monthly sponsor}	Vlad I _{💛 Active monthly sponsor}	小妍儿 _{💛 Active monthly sponsor}	Guilherme Costa _{💛 Active one-time sponsor}	Henrique Iurkiv _{💛 Active one-time sponsor}	Somesh Ghaturle _{💛 Active one-time sponsor}
Kolonie AI _{💛 Past one-time supporter}	Prof. Igor Morais _{💛 Past one-time supporter}	Pixma _{💛 Past one-time supporter}	Paco Cartones _{💛 Past one-time supporter}	longtao _{💛 Past one-time supporter}

Project	⭐	How it inspired OmniRoute
9router	31,004	The original project this fork is built on — extended here with multi-modal APIs and a full TypeScript rewrite.
CLIProxyAPI	55,591	The Go implementation that inspired this JavaScript / TypeScript port.
LiteLLM	61,482	The AI gateway whose public pricing dataset feeds our cost-tracking sync and whose provider-normalization model informed our routing.
codex-chatgpt-web	14,526	MIT source adapted into the vendored ChatGPT Web → Codex Responses bridge, including browser-session, response-framing, usage and web-search adapters.
free-claude-code	61,430	Patterns ported into stream recovery, no-thinking aliases, fallback web search, sliding-window limits, log redaction and hardened launcher flows.
composer-api	346	Cursor Composer tool-choice, output-constraint and tool-commit patterns adapted into the native Cursor executor.
codex-multi-auth	553	Fresh-login and refresh-token rotation patterns ported into Codex OAuth reauthentication.
opencode-anthropic-auth	558	Claude Code-compatible transform defaults and billing-header behavior generalized into OmniRoute's config-driven bridge.
grok2api-merged	2	Its Grok model mappings, fake-TypeError Statsig generator, request and device defaults, and NDJSON response processor were materially adapted into OmniRoute's Grok Web executor.
TQZHR/grok2api	706	The principal transitive code source behind grok2api-merged; its model, header, payload, Statsig and processor implementations are preserved in the Grok Web lineage.
chenyme/grok2api	7,819	The underlying MIT source for Grok payload and device defaults, the Statsig generator, and the `result.response` processor carried through TQZHR and grok2api-merged.
grok2api-pro	27	A transitive source credited by grok2api-merged for its proxy-pool layer; OmniRoute preserves that lineage notice but does not claim a proxy-pool port in its bounded Grok Web executor.
GrokProxy	51	Its cookie-authenticated Grok proxy and `result.response.token` streaming pattern informed OmniRoute's Grok Web transport.
GrokBridge	5	The original Grok Web implementation consulted its HTTP/browser upstream design; its direct HTTP path derives from GrokProxy, so no independent code port is claimed.

Project	⭐	How it inspired OmniRoute
Caveman	113,396	The viral "why use many token when few token do trick" project — its caveman-speak philosophy powers our standard compression mode and 30+ filler/condensation rules.
RTK – Rust Token Killer	83,835	High-performance command-output compression — inspired our RTK engine, JSON filter DSL, raw-output recovery and the stacked RTK → Caveman pipeline.
headroom	75,741	Reversible context-compression (SmartCrusher) — inspired our `headroom` engine and the `ccr` retrieve-marker pattern.
LLMLingua	6,757	Prompt-compression research (LLMLingua / LLMLingua-2) — inspired our async, code-safe, fail-open `llmlingua` engine.
llmlingua-2-js	32	The JS/ONNX port (MobileBERT / XLM-RoBERTa) used as the worker-thread backend for our LLMLingua engine.
Troglodita	50	PT-BR token compression — powers our pt-BR language pack: pleonasm reduction and filler removal tuned for Brazilian-Portuguese grammar.
ponytail	166,731	The viral "lazy senior dev" YAGNI-coder skill — inspired our less-code Output Style: smallest-working-change steering that cuts _generated_ code (the output-axis sibling to Caveman's terse prose).
i-have-adhd	57,628	Its action-first, ADHD-friendly response style was adapted into OmniRoute's concise output style across five languages.

Project	⭐	How it inspired OmniRoute
TOON	25,509	Token-Oriented Object Notation — its columnar, header-plus-rows model shaped our tabular compaction stage.
GCF – Graph Compact Format	59	Its compact graph format and generic-profile design informed OmniRoute's tabular compaction and Headroom codec format.
gcf-typescript	4	The MIT TypeScript implementation directly vendored and extended as the Headroom generic-profile codec.
token-optimizer-mcp	551	Brotli/SQLite cache + per-session context-delta — inspired our `session-dedup` engine.
token-savior	1,182	Bash-output compaction + MCP profiles — inspired our compression bail-out discipline and MCP tool-manifest reduction.
token-saver	154	Content-aware, per-file-type output compression with failure-aware bail-out — validated our per-type dispatch and minimum-gain skip.
token-optimizer	2,595	"Find the ghost tokens" — its offload + recoverable-handle pattern informed our CCR offload thinking.
TokenMizer	33	A session-graph + cross-turn line-dedup blueprint that informed our session-dedup design.
OmniCompress	3	Rust columnar-JSON + content-addressed retrieve + cross-message dedup — validated our `headroom`/`ccr`/`session-dedup` engine design and the cache-stable "compressed form is position-independent" invariant.
mcp-compressor	133	MCP tool-schema/description compression — informed our MCP tool-manifest cardinality reduction.
RepoMapper	217	Aider-style repo-map ranking — informed our repo-map / retrieval-ranking exploration.
quiet-shell-mcp	4	Declarative shell-output reduction over MCP — validated our declarative bash-output compaction.
ts-morph	6,205	TypeScript Compiler API toolkit — inspired our parser-based comment removal that preserves string, template and regex literals.

🚀 OmniRoute — The Free AI Gateway

💰 ~1.62B Tokens / Month Across Third-Party Free Tiers

⭐ Star the repo if OMNIROUTE helped you save money and make your work easier.

💬 Join the community

📈 The Gateway Keeps Growing

🧩 Available

🆓 Install, connect a provider, then route through one endpoint

💥 The Promise

🤔 Why OmniRoute?

🤝 Supported by our Open Source Friends

🎯 Combos — The Flagship

⚡ Zero-config — just use auto

🔀 Or build your own — 20 routing strategies

🧱 Resilience is built in (3 independent layers)

🏆 What Sets OmniRoute Apart

💚 Support OmniRoute

📡 OmniRoute Radar

✨ What's New

🤖 Compatible CLIs & Coding Agents

🌐 377 AI Providers — 153 Catalog-Marked Free

🏢 Every major lab — through one endpoint

🆓 Free Forever — $0, no card

🖥️ Where OmniRoute Runs — Anywhere

🧩 New: OmniRoute inside VS Code's native Copilot Chat

🎩 New: OmniRouteTray — your gateway, living in the menu bar

🔒 Private & Local-First

🔌 Full CLI + A2A & MCP

⌨️ A real CLI (not just start)

🛰️ Remote mode — run the CLI here, OmniRoute on a VPS

🤝 Connect an agent — and it controls OmniRoute itself

🗜️ Save 15–95% Tokens — Automatically

📖 How it works — pipeline, architecture & savings math

🧱 The 12-engine stack

🎚️ Beyond the engines — output styles, the adaptive dial & per-request control

⚡ Quick Start

📦 More install methods — Docker, source, pnpm, Arch

🎬 OmniRoute in Action

📹 Video Guides

📧 Community & Help

🛠️ Tech Stack

📖 Documentation

📘 Getting Started

🔧 Operations & Deployment

🧠 Features & Architecture

🤖 Protocols & APIs

📋 Project & Quality

⭐ Top Contributors

External contributors by merged pull requests

GitHub-attributed commits

💖 Sponsors

👥 900+ Contributors

How to Contribute

Releasing a New Version

📊 Stars

🌍 StarMapper

🙏 Acknowledgments

🧬 Lineage & gateway

🗜️ Context & token compression — engines

🧩 Compact formats, token research & code-aware tooling

🧠 Memory & RAG

🛰️ Traffic inspection, MITM & transparent proxy

📚 Model data, observability & UI

🛡️ Security

🧭 Complementary tools

📄 License

⚡ Zero-config — just use `auto`

⌨️ A real CLI (not just `start`)

Project	⭐	How it inspired OmniRoute
Mem0	67,385	Universal memory layer — its proxy-as-write/read-boundary model shaped our memory architecture.
Letta (MemGPT)	25,179	Stateful agents with tiered memory — inspired our Context Control & Recovery (CCR) tiered model.
WFGY	1,800	The ProblemMap taxonomy of 16 recurring RAG/LLM failure modes — the shared vocabulary in our troubleshooting guide.

Project	⭐	How it inspired OmniRoute
llm-interceptor	79	MITM interception/analysis of coding-assistant ↔ LLM traffic informed early Traffic Inspector requirements. Four previously derived modules — SSE merging, conversation normalization, secret masking and header sanitization — have been replaced by independent clean-room implementations based on public protocol standards. The two host-passthrough surfaces (`passthrough.ts` and `_internal/bypass.cjs`) remain OmniRoute-internal implementations classified independently; they were not rewritten as part of that replacement.
ProxyBridge	6,814	Transparent per-process proxy routing — inspired our crash-safe MITM teardown, socket idle-timeouts, `/proc` process attribution and TPROXY capture.

Project	⭐	How it inspired OmniRoute
models.dev	7,286	Open database of AI model specs, pricing and capabilities — synced natively into our model catalog.
React Flow / xyflow	38,705	The node-based graph library powering our real-time Compression Studio and Combo/Routing Studio.
LangGraph	43,443	LangGraph Studio's live workflow-graph visualization inspired our Studios' real-time cascade view.
Langfuse	35,990	Its trace → span → generation observability model shaped our Compression Studio waterfall.
Kiali	3,645	Istio service-mesh observability — inspired our circuit-breaker badges and error-edge visuals in the Routing/Combo Studio.
lobe-icons	2,615	AI/LLM brand logos that render the provider icons across our dashboard.
flag-icons	12,473	Provides the MIT-licensed SVG flags used by the README language selector.

Project	⭐	How it inspired OmniRoute
ClawRouter	6,628	Inspired request deduplication, emergency zero-cost fallback, pluggable Auto-Combo strategies and multilingual intent classification.
Antigravity-Manager	32,333	Its account-aware model remapping, executable-path validation and plan-label behavior informed OmniRoute's Antigravity runtime.
vscode-antigravity-cockpit	4,850	Its compact quota-reset countdown format inspired the corresponding provider-limit display in OmniRoute.
AionUi	33,611	Its ACP integrations inspired OmniRoute's automatic detection of installed CLI agents.
CodexBar	22,616	Identified the Grok Build quota surface; OmniRoute then verified and corrected the live wire format independently.