# AI tools for “Language model evaluation”

1,082 matching tools; showing 24, ranked by relevance.

Related categories: [ai-models](https://openaitools.app/category/ai-models.md), [large-language-models-llms](https://openaitools.app/category/large-language-models-llms.md)

| # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
| 1 | [Outlier AI](https://openaitools.app/tool/outlier-ai) | 10,372,036 | +7.6% | Paid | Get paid to train the next generation of AI models | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/outlier-ai.md) |
| 2 | [Appen](https://openaitools.app/tool/appen-com) | 665,840 | +0.2% | Contact for Pricing | Human-validated training data and evaluation services for frontier AI models | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/appen-com.md) |
| 3 | [Scale](https://openaitools.app/tool/scale) | 616,915 | +12.5% | Contact for Pricing | The data, evaluations and systems behind AI that has to be right. | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/scale.md) |
| 4 | [OpenTrain AI](https://openaitools.app/tool/opentrain-ai) | 1,469,348 | +11.2% | Contact for Pricing | Hire tested AI trainers and data labelers for RLHF, evaluation, and annotation | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/opentrain-ai.md) |
| 5 | [Future AGI](https://openaitools.app/tool/future-agi) | 121,741 | -7.8% | Freemium, Usage-based | Build, simulate, evaluate and monitor self-improving AI agents | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/future-agi.md) |
| 6 | [Klu](https://openaitools.app/tool/klu-ai-public-beta) | 30,504 | +44.3% | Freemium, Free Trial, Paid, Contact for Pricing | Evaluate every frontier model against your own workflows | category: ai-models, large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/klu-ai-public-beta.md) |
| 7 | [LangWatch](https://openaitools.app/tool/langwatch) | 52,098 | +73% | Contact for Pricing | Agent observability, evals and governance for AI platform teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/langwatch.md) |
| 8 | [Arize AI](https://openaitools.app/tool/arize-com) | 249,028 | +3.2% | Paid, Contact for Pricing | Agent observability, evaluation, and continuous improvement for production AI | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/arize-com.md) |
| 9 | [Confident AI](https://openaitools.app/tool/confident-ai) | 83,400 | -3.3% | Freemium, Paid, Contact for Pricing | Standardize LLM evaluation, observability, and red teaming across your whole org | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/confident-ai.md) |
| 10 | [Surge AI](https://openaitools.app/tool/surgehq-ai) | 245,142 | +6.6% | Contact for Pricing | Expert human data and evaluation for training frontier AI | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/surgehq-ai.md) |
| 11 | [Maxim AI](https://openaitools.app/tool/maxim-ai) | 121,351 | +10% | Contact for Pricing, Free Open Source | Evaluate, monitor, and govern your AI applications in production | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/maxim-ai.md) |
| 12 | [Label Studio](https://openaitools.app/tool/label-studio) | 137,199 | -16.1% | Contact for Pricing, Free | Label any data. Evaluate any AI. | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/label-studio.md) |
| 13 | [Google Gemini](https://openaitools.app/tool/gemini-gemini-advanced) | 2,637,398,242 | -0.1% | Freemium | Google's multimodal AI assistant powered by Gemini 4 Carbon (Gemini Carbon 4), Gemini 4 Argon, and Gemini 3.8 Flash with a 1M-token context window and Workspace integration. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/gemini-gemini-advanced.md) |
| 14 | [DeepSeek](https://openaitools.app/tool/deepseek) | 372,761,591 | +4.3% | Freemium | High-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs. | category: large-language-models-llms | [.md](https://openaitools.app/tool/deepseek.md) |
| 15 | [OpenAI Platform](https://openaitools.app/tool/openai) | 234,678,639 | -9.6% | Paid | Enterprise developer platform and API for deploying GPT-6 Astra, Sol, Luna, and realtime multimodal agents. | category: ai-models, large-language-models-llms | [.md](https://openaitools.app/tool/openai.md) |
| 16 | [Respan](https://openaitools.app/tool/respan) | 91,503 | -14.5% | Freemium | Open-source AI gateway with observability and evals built in | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/respan.md) |
| 17 | [Invisible Technologies](https://openaitools.app/tool/invisible-technologies-inc) | 1,364,520 | +64.4% | Contact for Pricing | Enterprise AI infrastructure where software and expert humans work together | category: ai-models, large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/invisible-technologies-inc.md) |
| 18 | [Langtail](https://openaitools.app/tool/langtail) | 4,213 | +10% | Freemium, Paid | Prompt management, evaluation, and guardrails for production LLM apps | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/langtail.md) |
| 19 | [Design Arena](https://openaitools.app/tool/design-arena) | 949,534 | -13.2% | Free | Crowdsourced arena where AI models compete and humans crown the best design output | category: ai-models; keywords 78% | [.md](https://openaitools.app/tool/design-arena.md) |
| 20 | [PromptLayer](https://openaitools.app/tool/promptlayer) | 85,899 | -4.6% | Free Trial, Contact for Pricing | The collaboration layer for AI engineering teams | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/promptlayer.md) |
| 21 | [BigModel](https://openaitools.app/tool/bigmodel) | 5,700,686 | -17% | Freemium | Zhipu AI's open platform for GLM large models, multimodal APIs, and agent building | category: ai-models, large-language-models-llms; semantic match | [.md](https://openaitools.app/tool/bigmodel.md) |
| 22 | [Gemma Open Models by Google](https://openaitools.app/tool/gemma-open-models-by-google) | 4,900,914 | -13.5% | Freemium, Paid | Google's family of lightweight, open-weight AI models | category: ai-models, large-language-models-llms; semantic match | [.md](https://openaitools.app/tool/gemma-open-models-by-google.md) |
| 23 | [ModelScope](https://openaitools.app/tool/modelscope-community) | 3,085,423 | +5.1% | Free | Open-source model and dataset hub with one-click online demos | category: ai-models, large-language-models-llms; keywords 100% | [.md](https://openaitools.app/tool/modelscope-community.md) |
| 24 | [Jev AI](https://openaitools.app/tool/jev-ai) | 29,625 | +117.4% | Free | Turn messy real-world state into structured, probability-backed decisions | category: large-language-models-llms; keywords 100%; semantic match | [.md](https://openaitools.app/tool/jev-ai.md) |

Page 1 of 46 · [Next page →](https://openaitools.app/index.md?q=Language+model+evaluation&page=2)

For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`.

---
Source: https://openaitools.app/?q=Language%20model%20evaluation

More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)