Respan: Open-source request routing with built-in evaluations, but has a smaller community and fewer pre-built provider connectors. LiteLLM 记录了 576,967 月访问量,月度环比增长为 +7.9%,定价为免费增值,定价请咨询。Respan 记录了 91,503 月访问量,增长率为 -14.5%,定价为免费增值。
| 维度 / 指标 | ![]() | ![]() |
|---|---|---|
| 官方域名 | litellm.ai | respan.ai |
| 定价模式 | 免费增值,定价请咨询 | 免费增值 |
| 月访问量 | 57.7万 (576,967) | 9.15万 (91,503) |
| 月度环比流量变化 | +4.25万 (+7.9%) | -1.55万 (-14.5%) |
| 主要市场与份额 | 🇺🇸 美国 (27.9%) | 🇺🇸 美国 (28.8%) |
| 直接访问 / 月 | 22.9万 | 2.31万 |
| 用户评分 | 4.8 | 4.5 |
| 支持的平台 | 网站 | 网站 |

一个开源 AI 网关,接入 100 多个 LLM 提供商
用一套请求格式调用 100 多个提供商和 1,800 多个模型,切换模型无须修改应用代码。
为团队、项目或应用签发限定范围的密钥,设置月度支出上限,清晰看到谁在用、花了多少。
在多个部署间分配流量,失败时自动重试,某个模型或提供商宕机时回退到备选。
用面板查看请求量、Token 数与各模型成本,并支持日志与分析工具集成。

内置可观测性与评测能力的开源 AI 网关
通过单一 API Key 和兼容 OpenAI 的端点,调用 OpenAI、Anthropic、Google、xAI、DeepSeek、Qwen 等众多模型。
继续使用现有的 OpenAI、Anthropic、LangChain 或 Vercel AI SDK 代码,仅需修改 base URL。
自动故障回退、重试以及跨供应商、跨密钥的负载均衡,让单个供应商限流或故障时请求仍能完成。
每次调用都可追溯并留有日志,配合评测工具与 CLI 可在终端直接查询日志和轨迹。

专项更强Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.
专项更强Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.
OrcaRouter is an OpenAI-compatible AI gateway that grades every prompt and routes it to the best-value model, then layers on failover, guardrails, an agent firewall, and compliance tooling for production AI.
OrcaRouter is an OpenAI-compatible AI gateway that grades every prompt and routes it to the best-value model, then layers on failover, guardrails, an agent firewall, and compliance tooling for production AI.

Unified LLM gateway with failover and analytics, but offers less robust open-source developer SDK support.

免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
免费 / 开源面向可靠 AI 应用的开源 LLM 可观测性与 AI 网关