Arize AI 每月有 249,028 次造訪，月增率 +3.2%，定價模式為付費、需聯絡報價。ClearML 每月有 20,123 次造訪，成長率 -60.9%，定價模式為需聯絡報價。
面向生產級 AI 的代理可觀測性、評估與持續改進平台
基於 OpenTelemetry 之上的 OpenInference 規範，蒐集代理與 LLM 呼叫的 span、trace 與工作階段，埋點可跨工具重複使用。
在 span、trace 與工作階段三個層級執行評估，對大量生產資料衡量檢索品質、工具呼叫與最終回覆的優劣。
內建於產品中的代理，可檢查链路、推斷根因，並給出供工程師上線前審閱的修復建議。
當需要讓軌跡資料留在自有基礎設施內時，可自行部署這套領先的開源追蹤與評估工具。
企業級 AI 基礎架構平台，統一管理 GPU 叢集並加速模型落地
統一連接與管理地端、雲端與混合 GPU 叢集，支援多租戶、RBAC、配額管理、GPU 切分與優先權排程。
面向建構者的工作台，內含整合開發環境、實驗追蹤、資料整合、儀表板、流水線、模型儲存庫與 CI/CD 整合。
在既有叢集上部署 LLM，自動處理網路、驗證與安全，讓團隊以較少手動設定上線安全的模型 API。
依運算時數、儲存與 API 呼叫細緻追蹤成本，協助 IT 團隊把開銷分攤回實際使用的專案與部門。
免費 / 開源在本機或雲端執行與打造開源 AI 模型
免費 / 開源ModelScope (魔搭社区) is an open-source AI community and model service platform that hosts thousands of pretrained models, datasets, and ready-to-run demos, backed by Alibaba Cloud infrastructure.
免費 / 開源ModelScope (魔搭社区) is an open-source AI community and model service platform that hosts thousands of pretrained models, datasets, and ready-to-run demos, backed by Alibaba Cloud infrastructure.
SuperAnnotate is an AI data platform that combines a collaborative multimodal annotation editor, an expert data-operations team, and the orchestration layer needed to move curated datasets into training, evaluation, and production pipelines. It is aimed at teams building computer vision, NLP, audio, and generative AI systems who need reliable, high-quality ground truth at scale.
SuperAnnotate is an AI data platform that combines a collaborative multimodal annotation editor, an expert data-operations team, and the orchestration layer needed to move curated datasets into training, evaluation, and production pipelines. It is aimed at teams building computer vision, NLP, audio, and generative AI systems who need reliable, high-quality ground truth at scale.
在互聯環境中追蹤、評估並交付 AI 模型與代理。
免費 / 開源Label Studio is an open-source data labeling and AI evaluation platform from HumanSignal. It handles images, video, audio, text, documents, time series and agent traces in one flexible workspace, and connects to your ML pipeline through an API, Python SDK and webhooks.
免費 / 開源Label Studio is an open-source data labeling and AI evaluation platform from HumanSignal. It handles images, video, audio, text, documents, time series and agent traces in one flexible workspace, and connects to your ML pipeline through an API, Python SDK and webhooks.
免費 / 開源打造、模擬、評估並監控能自我改進的 AI 代理
免費 / 開源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
免費 / 開源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
高度專注於提示詞管理與版本控制，而 Arize 則優先考慮端到端追蹤與機器學習可觀測性。
透過 DeepEval 提供全面的 LLM 評估與單元測試，但缺乏 Arize 深度生產監控基礎設施。
透過 DeepEval 提供全面的 LLM 評估與單元測試，但缺乏 Arize 深度生產監控基礎設施。
專項更強Stronger focus on compliance enforcement and AI governance, but less specialized for deep developer tracing workflows.
