# AI tools for “LLM Observability”

379 matching tools; showing 24, ranked by relevance.

Filters: `group=coding-development`

Related categories: [ai-models](https://openaitools.app/category/ai-models.md), [large-language-models-llms](https://openaitools.app/category/large-language-models-llms.md)

| # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
| 1 | [Arize AI](https://openaitools.app/tool/arize-com) | 249,028 | +3.2% | Paid, Contact for Pricing | Agent observability, evaluation, and continuous improvement for production AI | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/arize-com.md) |
| 2 | [LangWatch](https://openaitools.app/tool/langwatch) | 52,098 | +73% | Contact for Pricing | Agent observability, evals and governance for AI platform teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/langwatch.md) |
| 3 | [Helicone](https://openaitools.app/tool/helicone-ai) | 57,187 | -25.2% | Freemium, Free Trial, Paid, Contact for Pricing, Free | Open-source LLM observability and AI gateway for shipping reliable AI apps | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/helicone-ai.md) |
| 4 | [Portkey](https://openaitools.app/tool/portkey-ai) | 195,650 | -9.4% | Freemium, Paid, Contact for Pricing | AI gateway, observability and guardrails for production LLM apps | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/portkey-ai.md) |
| 5 | [Future AGI](https://openaitools.app/tool/future-agi) | 121,741 | -7.8% | Freemium, Usage-based | Build, simulate, evaluate and monitor self-improving AI agents | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/future-agi.md) |
| 6 | [Confident AI](https://openaitools.app/tool/confident-ai) | 83,400 | -3.3% | Freemium, Paid, Contact for Pricing | Standardize LLM evaluation, observability, and red teaming across your whole org | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/confident-ai.md) |
| 7 | [Datadog](https://openaitools.app/tool/datadog) | 5,175,760 | -4.8% | Freemium, Free Trial, Paid, Contact for Pricing, Free | Unified observability, security and incident response for cloud-scale engineering teams | keywords 100%; semantic match | [.md](https://openaitools.app/tool/datadog.md) |
| 8 | [Maxim AI](https://openaitools.app/tool/maxim-ai) | 121,351 | +10% | Contact for Pricing, Free Open Source | Evaluate, monitor, and govern your AI applications in production | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/maxim-ai.md) |
| 9 | [Middleware](https://openaitools.app/tool/middleware) | 35,967 | -12.3% | Freemium, Contact for Pricing | Full-stack observability with an AI SRE agent that fixes issues | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/middleware.md) |
| 10 | [honeyhive.ai](https://openaitools.app/tool/honeyhive-ai) | 8,835 | -52.5% | Freemium, Contact for Pricing | Observe, evaluate and monitor AI agents in production | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/honeyhive-ai.md) |
| 11 | [DeepSeek](https://openaitools.app/tool/deepseek) | 372,761,591 | +4.3% | Freemium | High-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs. | category: large-language-models-llms | [.md](https://openaitools.app/tool/deepseek.md) |
| 12 | [OpenAI Platform](https://openaitools.app/tool/openai) | 234,678,639 | -9.6% | Paid | Enterprise developer platform and API for deploying GPT-6 Astra, Sol, Luna, and realtime multimodal agents. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/openai.md) |
| 13 | [OpenLIT](https://openaitools.app/tool/openlit) | 6,028 | -18.3% | Free | Open-source, OpenTelemetry-native observability and harness engineering for AI agents | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/openlit.md) |
| 14 | [Openlayer](https://openaitools.app/tool/openlayer) | 48,415 | -6.4% | Freemium, Contact for Pricing | AI governance, testing, and observability for regulated enterprises | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/openlayer.md) |
| 15 | [LiteLLM](https://openaitools.app/tool/litellm) | 576,967 | +7.9% | Freemium, Contact for Pricing | One open-source AI gateway for 100+ LLM providers | category: large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/litellm.md) |
| 16 | [Respan](https://openaitools.app/tool/respan) | 91,503 | -14.5% | Freemium | Open-source AI gateway with observability and evals built in | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/respan.md) |
| 17 | [PromptLayer](https://openaitools.app/tool/promptlayer) | 85,899 | -4.6% | Free Trial, Contact for Pricing | The collaboration layer for AI engineering teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/promptlayer.md) |
| 18 | [Google AI Studio](https://openaitools.app/tool/google-ai-studio) | 112,620,020 | +2% | Freemium | Google's rapid prototyping IDE and developer API workbench for building multimodal applications with Gemini models. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/google-ai-studio.md) |
| 19 | [Ollama](https://openaitools.app/tool/ollama) | 9,421,973 | +4.3% | Free, Freemium, Paid | Run and build with open AI models locally or in the cloud | category: large-language-models-llms | [.md](https://openaitools.app/tool/ollama.md) |
| 20 | [Qwen 4 (Alibaba Qwen4)](https://openaitools.app/tool/qwen-4) | 35,101,353 | -6.2% | Freemium | Alibaba Cloud's 4th-generation multimodal AI assistant and foundation model lineup (Qwen4-Max, Qwen4-Plus, Qwen4-Flash & open-weight Qwen4-27B) with 1M context. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/qwen-4.md) |
| 21 | [Manifest](https://openaitools.app/tool/manifest) | 54,135 | -23% | Free | The open-source LLM gateway that fixes your agents' requests on the fly | category: large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/manifest.md) |
| 22 | [OpenRouter](https://openaitools.app/tool/openrouter-ai) | 19,941,437 | -6.2% | Paid | One API key for hundreds of AI models from every major provider | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/openrouter-ai.md) |
| 23 | [Raindrop](https://openaitools.app/tool/raindrop) | 42,807 | -18.4% | Free Trial, Paid, Contact for Pricing | Find and fix problems in your AI agents before users do | keywords 100%; semantic match | [.md](https://openaitools.app/tool/raindrop.md) |
| 24 | [Edgee](https://openaitools.app/tool/edgee) | 6,558 | +96.9% | Freemium, Contact for Pricing | Agent gateway that routes, compresses and observes your LLM token spend | category: large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/edgee.md) |

Page 1 of 16 · [Next page →](https://openaitools.app/index.md?q=LLM+Observability&group=coding-development&page=2)

For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`.

---
Source: https://openaitools.app/?q=LLM%20Observability

More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)
