Arize AI records 249,028 monthly visits with +3.2% month-over-month growth and Paid, Contact for Pricing pricing. OpenLIT records 6,028 monthly visits with -18.3% growth and Free pricing.
Agent observability, evaluation, and continuous improvement for production AI
Open-source, OpenTelemetry-native observability and harness engineering for AI agents
| Dimension / Metric | | |
|---|---|---|
| Official Domain | arize.com | openlit.io |
| Pricing Model | Paid, Contact for Pricing | Free |
| Monthly Visits | 249.03K (249,028) | 6.03K (6,028) |
| MoM Traffic Delta | +7.67K (+3.2%) | -1.35K (-18.3%) |
| Primary Market & Share | 🇺🇸 United States (51.6%) | 🇺🇸 United States (53.6%) |
| Direct Visits / mo | 107.84K | 2.38K |
| User Rating | 4.6 | 4.7 |
| Supported Platforms | Website | Website |
Agent observability, evaluation, and continuous improvement for production AI
Capture spans, traces, and sessions across agents and LLM calls using OpenInference conventions built on OpenTelemetry, so instrumentation stays portable.
Run evaluations at span, trace, and session level to grade retrieval quality, tool use, and final answers across large production datasets.
An in-product agent that inspects traces, diagnoses likely root causes, and proposes fixes that engineers can review before shipping.
Self-host the leading open-source tracing and eval tool when you need to keep trace data inside your own infrastructure.
Open-source, OpenTelemetry-native observability and harness engineering for AI agents
Capture OpenTelemetry traces and metrics for every LLM call, tool invocation, retrieval, and agent step, and filter them by user, session, cost, latency, or custom metadata.
Score production traffic or experiments with LLM-as-a-judge, heuristic checks, or human review so you can measure accuracy, relevance, and safety over time.
Manage and version prompts in Prompt Hub, then deploy, roll back, and update prompts without shipping new application code.
Store and rotate OpenAI, Anthropic, and other LLM API keys outside your codebase with an encrypted, rotating secrets vault.
Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceOne open-source AI gateway for 100+ LLM providers
Excels at experiment tracking and model registry workflows, but is less purpose-built for real-time LLM production observability.
Excels at experiment tracking and model registry workflows, but is less purpose-built for real-time LLM production observability.
AI gateway, observability and guardrails for production LLM apps
Free / Open-sourceBuild, simulate, evaluate and monitor self-improving AI agents
Free / Open-sourceBuild, simulate, evaluate and monitor self-improving AI agents
Free / Open-sourceEvaluate, monitor, and govern your AI applications in production
Free / Open-sourceEvaluate, monitor, and govern your AI applications in production
Free / Open-sourceOpen-source AI gateway with observability and evals built in
Free / Open-sourceOpen-source AI gateway with observability and evals built in
The collaboration layer for AI engineering teams
The collaboration layer for AI engineering teams
Standardize LLM evaluation, observability, and red teaming across your whole org
Standardize LLM evaluation, observability, and red teaming across your whole org
Free / Open-sourceOpen-source LLM observability and AI gateway for shipping reliable AI apps
Free / Open-sourceOpen-source LLM observability and AI gateway for shipping reliable AI apps
Free / Open-sourceAgent observability, evals and governance for AI platform teams
Free / Open-sourceAgent observability, evals and governance for AI platform teams
SpecialistStronger focus on compliance enforcement and AI governance, but less specialized for deep developer tracing workflows.
SpecialistStronger focus on compliance enforcement and AI governance, but less specialized for deep developer tracing workflows.
