免费 / 开源在本地或云端运行和构建开源 AI 模型
Arize AI 记录了 249,028 月访问量,月度环比增长为 +3.2%,定价为付费,定价请咨询。ClearML 记录了 20,123 月访问量,增长率为 -60.9%,定价为定价请咨询。

面向生产级 AI 的智能体可观测性、评估与持续改进平台
基于 OpenTelemetry 之上的 OpenInference 规范,采集智能体与 LLM 调用的 span、trace 和会话,埋点可跨工具复用。
在 span、trace 与会话三个层级运行评估,对海量生产数据衡量检索质量、工具调用与最终回答的优劣。
内置于产品中的智能体,可检查链路、推断根因,并给出供工程师上线前审阅的修复建议。
当需要让轨迹数据留在自有基础设施内时,可自行部署这一领先的开源追踪与评估工具。

面向企业的 AI 基础设施平台,统一管理 GPU 集群并加速模型落地
统一连接和管理本地、云端与混合 GPU 集群,支持多租户、RBAC、配额管理、GPU 分片与优先级调度。
面向构建者的工作台,含集成开发环境、实验追踪、数据集成、仪表盘、流水线、模型仓库与 CI/CD 集成。
在既有集群上部署 LLM,自动处理网络、认证与安全,让团队以较少手动配置上线安全的模型 API。
按计算时长、存储和 API 调用细粒度追踪成本,帮助 IT 团队把开销分摊回实际使用的项目与部门。
免费 / 开源在本地或云端运行和构建开源 AI 模型
免费 / 开源ModelScope (魔搭社区) is an open-source AI community and model service platform that hosts thousands of pretrained models, datasets, and ready-to-run demos, backed by Alibaba Cloud infrastructure.
免费 / 开源ModelScope (魔搭社区) is an open-source AI community and model service platform that hosts thousands of pretrained models, datasets, and ready-to-run demos, backed by Alibaba Cloud infrastructure.

SuperAnnotate is an AI data platform that combines a collaborative multimodal annotation editor, an expert data-operations team, and the orchestration layer needed to move curated datasets into training, evaluation, and production pipelines. It is aimed at teams building computer vision, NLP, audio, and generative AI systems who need reliable, high-quality ground truth at scale.
SuperAnnotate is an AI data platform that combines a collaborative multimodal annotation editor, an expert data-operations team, and the orchestration layer needed to move curated datasets into training, evaluation, and production pipelines. It is aimed at teams building computer vision, NLP, audio, and generative AI systems who need reliable, high-quality ground truth at scale.

在互联环境中跟踪、评估并交付 AI 模型与智能体。

免费 / 开源Label Studio is an open-source data labeling and AI evaluation platform from HumanSignal. It handles images, video, audio, text, documents, time series and agent traces in one flexible workspace, and connects to your ML pipeline through an API, Python SDK and webhooks.
免费 / 开源Label Studio is an open-source data labeling and AI evaluation platform from HumanSignal. It handles images, video, audio, text, documents, time series and agent traces in one flexible workspace, and connects to your ML pipeline through an API, Python SDK and webhooks.
免费 / 开源构建、模拟、评估并监控可自我改进的 AI 智能体

免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
高度专注提示词管理与版本控制,而 Arize 则优先考虑端到端追踪与机器学习可观测性。

通过 DeepEval 提供全面的大模型评估和单元测试,但缺乏 Arize 深入的生产监控基础设施。
通过 DeepEval 提供全面的大模型评估和单元测试,但缺乏 Arize 深入的生产监控基础设施。
专项更强Stronger focus on compliance enforcement and AI governance, but less specialized for deep developer tracing workflows.