LiteLLM 每月有 576,967 次造訪,月增率 +7.9%,定價模式為免費增值、需聯絡報價。Rivet.dev 每月有 21,359 次造訪,成長率 -44.3%,定價模式為免費增值、需聯絡報價。

在你自己的基礎設施上執行與擴展持久化 AI Agent
| 面向/指標 | ![]() | ![]() |
|---|---|---|
| 官方網域 | litellm.ai | rivet.dev |
| 定價模式 | 免費增值、需聯絡報價 | 免費增值、需聯絡報價 |
| 每月造訪次數 | 57.7萬 (576,967) | 2.14萬 (21,359) |
| 月流量變化量 | +4.25萬 (+7.9%) | -1.7萬 (-44.3%) |
| 主要市場與市佔 | 🇺🇸 美國 (27.9%) | 🇺🇸 美國 (39.4%) |
| 每月直接造訪 | 22.9萬 | 1.07萬 |
| 使用者評分 | 4.8 | 4.5 |
| 支援平台 | 網站 | 網站 |

一個開源 AI 閘道,接入 100 多個 LLM 供應商
用一套請求格式呼叫 100 多個供應商與 1,800 多個模型,切換模型無須修改應用程式碼。
為團隊、專案或應用簽發限定範圍的金鑰,設定每月支出上限,清楚看到誰在用、花了多少。
在多個部署間分配流量,失敗時自動重試,某個模型或供應商故障時回退到備選。
用面板查看請求量、Token 數與各模型成本,並支援日誌與分析工具整合。

在你自己的基礎設施上執行與擴展持久化 AI Agent
每個 Actor 都擁有 SQLite 資料庫與檔案系統,Agent 的記憶與進度可在重啟與閒置後保留,無需額外資料庫。
在你自己的基礎設施上執行不受信任或 AI 產生的程式碼,並可細緻控制網路存取、檔案系統權限與資源上限。
節點故障時其 Actor 會帶狀態遷移到其他節點,多步驟工作在崩潰後自動重播,無需自建檢查點機制。
可透過 HTTP 直接定址 Actor 或維持即時 WebSocket 連線,並用 React SDK 讓元件訂閱 Actor 狀態以即時更新。

專項更強Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.
專項更強Hosts high-performance open-weight models directly on dedicated serverless infrastructure, but does not route across external providers.
透過 API 閘道器提供自動模型備援切換與預算管理,但開源自訂性較低。

Unified LLM gateway with failover and analytics, but offers less robust open-source developer SDK support.

免費 / 開源Mastra is an open-source TypeScript framework for building, deploying, and observing AI agents and workflows. It gives JavaScript developers typed agents, durable workflows, memory, MCP tool support, and built-in observability so prototypes can scale into production.
免費 / 開源Mastra is an open-source TypeScript framework for building, deploying, and observing AI agents and workflows. It gives JavaScript developers typed agents, durable workflows, memory, MCP tool support, and built-in observability so prototypes can scale into production.
提供進階的企業級可觀測性與安全防護工具,但缺乏 LiteLLM 那種輕量、自架代理伺服器的簡便性。
免費 / 開源一個用來統一 LLM 供應商的開源替代方案,但中介軟體整合的生態系較不那麼豐富。

Coder is a self-hosted development infrastructure platform that gives engineering organizations secure, standardized cloud workspaces plus governance over the AI coding agents that run inside them. It is built for enterprises that need speed for developers and control for security and compliance teams.
Coder is a self-hosted development infrastructure platform that gives engineering organizations secure, standardized cloud workspaces plus governance over the AI coding agents that run inside them. It is built for enterprises that need speed for developers and control for security and compliance teams.

免費 / 開源Open-source request routing with built-in evaluations, but has a smaller community and fewer pre-built provider connectors.