# AI tools for “LLM Observability”

701 matching tools; showing 24, ranked by relevance.

Related categories: [ai-models](https://openaitools.app/category/ai-models.md), [large-language-models-llms](https://openaitools.app/category/large-language-models-llms.md)

| # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
| 1 | [Arize AI](https://openaitools.app/tool/arize-com) | 249,028 | +3.2% | Paid, Contact for Pricing | Agent observability, evaluation, and continuous improvement for production AI | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/arize-com.md) |
| 2 | [LangWatch](https://openaitools.app/tool/langwatch) | 52,098 | +73% | Contact for Pricing | Agent observability, evals and governance for AI platform teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/langwatch.md) |
| 3 | [Helicone](https://openaitools.app/tool/helicone-ai) | 57,187 | -25.2% | Freemium, Free Trial, Paid, Contact for Pricing, Free | Open-source LLM observability and AI gateway for shipping reliable AI apps | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/helicone-ai.md) |
| 4 | [Portkey](https://openaitools.app/tool/portkey-ai) | 195,650 | -9.4% | Freemium, Paid, Contact for Pricing | AI gateway, observability and guardrails for production LLM apps | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/portkey-ai.md) |
| 5 | [Latitude](https://openaitools.app/tool/latitude) | 48,210 | -30.6% | Freemium, Open Source, Enterprise | Open-source observability that finds your AI agent's failures — and fixes them | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/latitude.md) |
| 6 | [Fiddler AI](https://openaitools.app/tool/fiddler-ai) | 44,204 | -10.2% | Contact for Pricing | The control plane for trusted enterprise agents and models | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/fiddler-ai.md) |
| 7 | [Future AGI](https://openaitools.app/tool/future-agi) | 121,741 | -7.8% | Freemium, Usage-based | Build, simulate, evaluate and monitor self-improving AI agents | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/future-agi.md) |
| 8 | [Confident AI](https://openaitools.app/tool/confident-ai) | 83,400 | -3.3% | Freemium, Paid, Contact for Pricing | Standardize LLM evaluation, observability, and red teaming across your whole org | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/confident-ai.md) |
| 9 | [Datadog](https://openaitools.app/tool/datadog) | 5,175,760 | -4.8% | Freemium, Free Trial, Paid, Contact for Pricing, Free | Unified observability, security and incident response for cloud-scale engineering teams | keywords 100%; semantic match | [.md](https://openaitools.app/tool/datadog.md) |
| 10 | [Maxim AI](https://openaitools.app/tool/maxim-ai) | 121,351 | +10% | Contact for Pricing, Free Open Source | Evaluate, monitor, and govern your AI applications in production | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/maxim-ai.md) |
| 11 | [Middleware](https://openaitools.app/tool/middleware) | 35,967 | -12.3% | Freemium, Contact for Pricing | Full-stack observability with an AI SRE agent that fixes issues | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/middleware.md) |
| 12 | [Google Gemini](https://openaitools.app/tool/gemini-gemini-advanced) | 2,637,398,242 | -0.1% | Freemium | Google's multimodal AI assistant powered by Gemini 4 Carbon (Gemini Carbon 4), Gemini 4 Argon, and Gemini 3.8 Flash with a 1M-token context window and Workspace integration. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/gemini-gemini-advanced.md) |
| 13 | [honeyhive.ai](https://openaitools.app/tool/honeyhive-ai) | 8,835 | -52.5% | Freemium, Contact for Pricing | Observe, evaluate and monitor AI agents in production | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/honeyhive-ai.md) |
| 14 | [DeepSeek](https://openaitools.app/tool/deepseek) | 372,761,591 | +4.3% | Freemium | High-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs. | category: large-language-models-llms | [.md](https://openaitools.app/tool/deepseek.md) |
| 15 | [OpenAI Platform](https://openaitools.app/tool/openai) | 234,678,639 | -9.6% | Paid | Enterprise developer platform and API for deploying GPT-6 Astra, Sol, Luna, and realtime multimodal agents. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/openai.md) |
| 16 | [OpenLIT](https://openaitools.app/tool/openlit) | 6,028 | -18.3% | Free | Open-source, OpenTelemetry-native observability and harness engineering for AI agents | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/openlit.md) |
| 17 | [Openlayer](https://openaitools.app/tool/openlayer) | 48,415 | -6.4% | Freemium, Contact for Pricing | AI governance, testing, and observability for regulated enterprises | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/openlayer.md) |
| 18 | [LiteLLM](https://openaitools.app/tool/litellm) | 576,967 | +7.9% | Freemium, Contact for Pricing | One open-source AI gateway for 100+ LLM providers | category: large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/litellm.md) |
| 19 | [Respan](https://openaitools.app/tool/respan) | 91,503 | -14.5% | Freemium | Open-source AI gateway with observability and evals built in | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/respan.md) |
| 20 | [PromptLayer](https://openaitools.app/tool/promptlayer) | 85,899 | -4.6% | Free Trial, Contact for Pricing | The collaboration layer for AI engineering teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/promptlayer.md) |
| 21 | [Google AI Studio](https://openaitools.app/tool/google-ai-studio) | 112,620,020 | +2% | Freemium | Google's rapid prototyping IDE and developer API workbench for building multimodal applications with Gemini models. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/google-ai-studio.md) |
| 22 | [Ollama](https://openaitools.app/tool/ollama) | 9,421,973 | +4.3% | Free, Freemium, Paid | Run and build with open AI models locally or in the cloud | category: large-language-models-llms | [.md](https://openaitools.app/tool/ollama.md) |
| 23 | [Qwen 4 (Alibaba Qwen4)](https://openaitools.app/tool/qwen-4) | 35,101,353 | -6.2% | Freemium | Alibaba Cloud's 4th-generation multimodal AI assistant and foundation model lineup (Qwen4-Max, Qwen4-Plus, Qwen4-Flash & open-weight Qwen4-27B) with 1M context. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/qwen-4.md) |
| 24 | [Manifest](https://openaitools.app/tool/manifest) | 54,135 | -23% | Free | The open-source LLM gateway that fixes your agents' requests on the fly | category: large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/manifest.md) |

Page 1 of 30 · [Next page →](https://openaitools.app/index.md?q=LLM+Observability&page=2)

For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`.

---
Source: https://openaitools.app/?q=LLM%20Observability

More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)
