免費 / 開源由 DeepSeek-V4 與 R1 驅動的高效開源權重與託管推理 AI,token 成本極低。
OrcaRouter 每月有 975,300 次造訪,月增率 -5.2%,定價模式為免費增值。RightNow Inference(RunInfra)每月有 18,110 次造訪,成長率 -22.6%,定價模式為免費試用、付費、需聯絡報價。

為代理快速提供開源模型推論,搭配熱快取路由
| 面向/指標 | ![]() | |
|---|---|---|
| 官方網域 | orcarouter.ai | runinfra.ai |
| 定價模式 | 免費增值 | 免費試用、付費、需聯絡報價 |
| 每月造訪次數 | 97.53萬 (975,300) | 1.81萬 (18,110) |
| 月流量變化量 | -5.38萬 (-5.2%) | -5280 (-22.6%) |
| 主要市場與市佔 | 🇺🇸 美國 (21.5%) | 🇮🇳 印度 (48.4%) |
| 每月直接造訪 | 24.97萬 | 7781 |
| 使用者評分 | 4.3 | 4.4 |
| 支援平台 | 網站 | 網站 |
OrcaRouter is an OpenAI-compatible AI gateway that grades every prompt and routes it to the best-value model, then layers on failover, guardrails, an agent firewall, and compliance tooling for production AI.
Each prompt is graded and routed to the model that clears your quality bar, with configurable fallback chains that retry before a response starts.
Pay provider prices with $0 per-token added on pay-as-you-go and subscriptions, or bring your own provider keys and credits.
PII shielding, jailbreak and injection blocking, and per-call approval for tool and MCP actions run before you are billed.
Request logs, per-prompt receipts, routing and spend dashboards, and copy-as-cURL make every call auditable and attributable.

為代理快速提供開源模型推論,搭配熱快取路由
自動讓同一代理工作階段的重複呼叫落在已持有其上下文的副本上,快取命中率可報導達約 99%,明顯降低有效輸入成本。
一把 API 金鑰同時適用於 OpenAI 與 Anthropic SDK,現有代理程式碼只需極少修改即可切換服務商。
提供具公開定價的開源模型,支援工具呼叫、JSON 模式、串流輸出與影像輸入,並公布即時輸出速度與快取指標。
快取命中會顯示在用量中並依快取費率計費,同時公開測量方法與各模型的有效輸入價格。
免費 / 開源由 DeepSeek-V4 與 R1 驅動的高效開源權重與託管推理 AI,token 成本極低。
免費 / 開源在本機或雲端執行與打造開源 AI 模型

Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all backed by in-house systems research.
Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all backed by in-house systems research.

免費 / 開源提供具備容錯移轉的開源 Proxy 與 SDK 以整合 100 多個 LLM,但需要自行架設而非託管服務。

Routes requests across frontier models with automatic failover and analytics, serving as a straightforward alternative API proxy.
用一個 API 快速、可預測成本地執行 LLM 與多模態模型