One API key for hundreds of AI models from every major provider
LLM Gateway records 168,426 monthly visits with -14.5% month-over-month growth and Freemium, Contact for Pricing pricing. Respan records 91,503 monthly visits with -14.5% growth and Freemium pricing.

Open-source AI gateway with observability and evals built in
| Dimension / Metric | ![]() | |
|---|---|---|
| Official Domain | llmgateway.io | respan.ai |
| Pricing Model | Freemium, Contact for Pricing | Freemium |
| Monthly Visits | 168.43K (168,426) | 91.5K (91,503) |
| MoM Traffic Delta | -28.46K (-14.5%) | -15.53K (-14.5%) |
| Primary Market & Share | 🇰🇷 South Korea (18.1%) | 🇺🇸 United States (28.8%) |
| Direct Visits / mo | 98.62K | 23.12K |
| User Rating | 4.6 | 4.5 |
| Supported Platforms | Website | Website |
One OpenAI-compatible API to route, monitor and control 250+ LLM models
Keep your existing OpenAI SDK code and change only the base URL to reach 250+ models from 40+ providers through one integration.
If a provider errors, times out or rate-limits, the gateway can retry up to twice on another provider within the same request, so your app still gets a response.
Track requests, tokens, total spend and average cost per 1K tokens, plus per-model and per-provider breakdowns, cache hit rates and error monitoring.
Detect prompt injection, jailbreak attempts, PII, card numbers and secrets, then block, redact or warn; manage all provider keys in one scoped dashboard.

Open-source AI gateway with observability and evals built in
Route to OpenAI, Anthropic, Google, xAI, DeepSeek, Qwen and many other models through a single API key and one OpenAI-compatible endpoint.
Keep your existing OpenAI, Anthropic, LangChain or Vercel AI SDK code and change only the base URL.
Automatic fallbacks, retries and load balancing across providers and API keys keep requests answering when a single provider rate-limits or fails.
Every call is logged and traceable, with evaluation tooling and a CLI so you can query logs and traces from your terminal.
One API key for hundreds of AI models from every major provider
One OpenAI-compatible gateway for adaptive LLM routing, guardrails, and spend control
One OpenAI-compatible gateway for adaptive LLM routing, guardrails, and spend control

Free / Open-sourceOne open-source AI gateway for 100+ LLM providers

Unifies access to 100+ frontier models with built-in chat UI, but offers fewer enterprise compliance integrations.
Unifies access to 100+ frontier models with built-in chat UI, but offers fewer enterprise compliance integrations.
One API key for hundreds of AI models
AI gateway, observability and guardrails for production LLM apps

One API gateway and LLM router for around 1,000 AI models

Free / Open-sourceEvaluate, monitor, and govern your AI applications in production
Free / Open-sourceEvaluate, monitor, and govern your AI applications in production

One API key for 70+ AI models, 1,000+ data APIs and web tools
Free / Open-sourceOpen-source LLM observability and AI gateway for shipping reliable AI apps
Free / Open-sourceOpen-source LLM observability and AI gateway for shipping reliable AI apps

Free / Open-sourceThe open-source LLM gateway that fixes your agents' requests on the fly
Free / Open-sourceThe open-source LLM gateway that fixes your agents' requests on the fly

Free / Open-sourceAgent observability, evals and governance for AI platform teams
Free / Open-sourceAgent observability, evals and governance for AI platform teams