
免费 / 开源面向生产级 AI 的智能体可观测性、评估与持续改进平台
Openlayer 记录了 48,415 月访问量,月度环比增长为 -6.4%,定价为免费增值,定价请咨询。Relyable 记录了 3,451 月访问量,增长率为 -45.5%,定价为免费增值,付费。

Relyable is a simulation and monitoring platform for AI voice agents. It connects to voice stacks like Vapi, Retell and ElevenLabs so teams can generate hundreds of realistic test conversations, grade every call against a custom rubric, and monitor live production traffic with threshold-based alerts.
| 维度 / 指标 | ![]() | |
|---|---|---|
| 官方域名 | openlayer.com | relyable.ai |
| 定价模式 | 免费增值,定价请咨询 | 免费增值,付费 |
| 月访问量 | 4.84万 (48,415) | 3451 (3,451) |
| 月度环比流量变化 | -3303 (-6.4%) | -2882 (-45.5%) |
| 主要市场与份额 | 🇺🇸 美国 (44.1%) | 🇺🇸 美国 (72.6%) |
| 直接访问 / 月 | 2.59万 | 1348 |
| 用户评分 | 4.4 | 4.7 |
| 支持的平台 | 网站 | 网站 |
Openlayer is a platform that tests AI systems before release, monitors them in production, and enforces policy and compliance requirements across every model and agent your company runs.
Dozens of pre-built evaluations cover quality, safety, security, and performance, with LLM-as-a-judge scorers, session-level metrics, and support for writing your own custom tests against your own data.
Import a repository and run evaluation suites automatically on every change, benchmark each iteration, and block releases when a metric regresses beyond the threshold you define.
Trace every request through multi-step agent workflows, including tool calls and retriever steps, with token counts, latency, cost per request, alerting integrations, and subpopulation analysis.
Register each AI system with an owner, purpose, data sensitivity, and risk tier, score inherent risk across multiple dimensions, and move systems through staged approval gates before they reach production.

Relyable is a simulation and monitoring platform for AI voice agents. It connects to voice stacks like Vapi, Retell and ElevenLabs so teams can generate hundreds of realistic test conversations, grade every call against a custom rubric, and monitor live production traffic with threshold-based alerts.
Auto-generate test cases from your system prompt or define your own, then run hundreds of parallel simulated conversations with presets for accent, mood and goal.
Score every call against weighted, customisable criteria such as task completion, policy accuracy, sentiment, interruption handling and latency, with seven-day trend tracking.
Every production call is silently logged and scored in real time, with alerts routed to Slack, email, PagerDuty, Opsgenie, Linear or webhooks when something drifts.
Connect Vapi, Retell or ElevenLabs agents in under five minutes using an API key, or route custom agents through the provided number and API.

免费 / 开源面向生产级 AI 的智能体可观测性、评估与持续改进平台

专项更强Mindgard is an AI security platform that performs attacker-style reconnaissance, automated red teaming, and continuous testing of AI models, agents, and applications to find and fix exploitable vulnerabilities.
免费 / 开源构建、模拟、评估并监控可自我改进的 AI 智能体

免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
免费 / 开源Maxim AI is a platform for evaluating, testing, and monitoring AI applications, and the home of Bifrost, an open-source LLM gateway. It helps teams ship reliable AI features with tracing, evaluation, agent simulation, and production observability.
专项更强AI 工程团队的协作层
在整个组织内统一 LLM 评估、可观测性与红队测试标准
专项更强值得信赖的企业智能体与模型控制平面
配备可自动修复问题的 AI SRE 代理的全栈可观测性平台
语音与聊天智能体的安全层:测试、红队演练与全程监控
面向智能体客户体验的信任平台,测试、监控并洞察每一次客户旅程