OrcaRouter: 通过 API 网关提供自动模型故障转移与预算管理,但开源自定义性较低。 LiteLLM 记录了 576,967 月访问量,月度环比增长为 +7.9%,定价为免费增值,定价请咨询。OrcaRouter 记录了 975,300 月访问量,增长率为 -5.2%,定价为免费增值。
| 维度 / 指标 | ![]() | |
|---|---|---|
| 官方域名 | litellm.ai | orcarouter.ai |
| 定价模式 | 免费增值,定价请咨询 | 免费增值 |
| 月访问量 | 57.7万 (576,967) | 97.53万 (975,300) |
| 月度环比流量变化 | +4.25万 (+7.9%) | -5.38万 (-5.2%) |
| 主要市场与份额 | 🇺🇸 美国 (27.9%) | 🇺🇸 美国 (21.5%) |
| 直接访问 / 月 | 22.9万 | 24.97万 |
| 用户评分 | 4.8 | 4.3 |
| 支持的平台 | 网站 | 网站 |

一个开源 AI 网关,接入 100 多个 LLM 提供商
用一套请求格式调用 100 多个提供商和 1,800 多个模型,切换模型无须修改应用代码。
为团队、项目或应用签发限定范围的密钥,设置月度支出上限,清晰看到谁在用、花了多少。
在多个部署间分配流量,失败时自动重试,某个模型或提供商宕机时回退到备选。
用面板查看请求量、Token 数与各模型成本,并支持日志与分析工具集成。
OrcaRouter is an OpenAI-compatible AI gateway that grades every prompt and routes it to the best-value model, then layers on failover, guardrails, an agent firewall, and compliance tooling for production AI.
Each prompt is graded and routed to the model that clears your quality bar, with configurable fallback chains that retry before a response starts.
Pay provider prices with $0 per-token added on pay-as-you-go and subscriptions, or bring your own provider keys and credits.
PII shielding, jailbreak and injection blocking, and per-call approval for tool and MCP actions run before you are billed.
Request logs, per-prompt receipts, routing and spend dashboards, and copy-as-cURL make every call auditable and attributable.

专项更强Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.
专项更强Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.

用一个 OpenAI 兼容 API 密钥访问 500+ AI 模型
用一个 OpenAI 兼容 API 密钥访问 500+ AI 模型

Routes requests across frontier models with automatic failover and analytics, serving as a straightforward alternative API proxy.
Gives developers a single OpenAI-compatible endpoint for multiple LLMs with failover, but offers fewer advanced routing rules.
提供具备高级缓存和可观测性的企业级 LLM 网关功能,不过运行复杂度更高。

免费 / 开源Open-source request routing with built-in evaluations, but has a smaller community and fewer pre-built provider connectors.
免费 / 开源Open-source request routing with built-in evaluations, but has a smaller community and fewer pre-built provider connectors.
专项更强面向可靠 AI 应用的开源 LLM 可观测性与 AI 网关

免费 / 开源一个可在运行中修复失败 LLM 请求的开源路由网关,专注于韧性而非计费控制。