# AI tools for “Open-source evaluation”

932 matching tools; showing 24, ranked by relevance.

Related categories: [open-source-ai-models](https://openaitools.app/category/open-source-ai-models.md)

| # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
| 1 | [DeepSeek](https://openaitools.app/tool/deepseek) | 372,761,591 | +4.3% | Freemium | High-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs. | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/deepseek.md) |
| 2 | [ModelScope](https://openaitools.app/tool/modelscope-community) | 3,085,423 | +5.1% | Free | Open-source model and dataset hub with one-click online demos | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/modelscope-community.md) |
| 3 | [Label Studio](https://openaitools.app/tool/label-studio) | 137,199 | -16.1% | Contact for Pricing, Free | Label any data. Evaluate any AI. | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/label-studio.md) |
| 4 | [Open Apps](https://openaitools.app/tool/open-apps) | 55,880 | +6.1% | Free | Independently scored open-source alternatives to paid SaaS | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/open-apps.md) |
| 5 | [Arize AI](https://openaitools.app/tool/arize-com) | 249,028 | +3.2% | Paid, Contact for Pricing | Agent observability, evaluation, and continuous improvement for production AI | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/arize-com.md) |
| 6 | [Qwen 4 (Alibaba Qwen4)](https://openaitools.app/tool/qwen-4) | 35,101,353 | -6.2% | Freemium | Alibaba Cloud's 4th-generation multimodal AI assistant and foundation model lineup (Qwen4-Max, Qwen4-Plus, Qwen4-Flash & open-weight Qwen4-27B) with 1M context. | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/qwen-4.md) |
| 7 | [Confident AI](https://openaitools.app/tool/confident-ai) | 83,400 | -3.3% | Freemium, Paid, Contact for Pricing | Standardize LLM evaluation, observability, and red teaming across your whole org | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/confident-ai.md) |
| 8 | [Civitai](https://openaitools.app/tool/civitai) | 6,963,136 | +12.8% | Freemium | Discover, download and generate with open-source AI models for image, video and 3D. | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/civitai.md) |
| 9 | [Ollama](https://openaitools.app/tool/ollama) | 9,421,973 | +4.3% | Free, Freemium, Paid | Run and build with open AI models locally or in the cloud | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/ollama.md) |
| 10 | [Klu](https://openaitools.app/tool/klu-ai-public-beta) | 30,504 | +44.3% | Freemium, Free Trial, Paid, Contact for Pricing | Evaluate every frontier model against your own workflows | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/klu-ai-public-beta.md) |
| 11 | [Gemma Open Models by Google](https://openaitools.app/tool/gemma-open-models-by-google) | 4,900,914 | -13.5% | Freemium, Paid | Google's family of lightweight, open-weight AI models | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/gemma-open-models-by-google.md) |
| 12 | [OpenLIT](https://openaitools.app/tool/openlit) | 6,028 | -18.3% | Free | Open-source, OpenTelemetry-native observability and harness engineering for AI agents | category: open-source-ai-models; keywords 100%; semantic match | [.md](https://openaitools.app/tool/openlit.md) |
| 13 | [Together AI](https://openaitools.app/tool/together-ai) | 1,645,930 | +64.9% | Freemium, Paid | Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all b | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/together-ai.md) |
| 14 | [Groq](https://openaitools.app/tool/groq) | 3,987,936 | +10% | Paid | Ultra-fast AI inference on the LPU and LPX platform | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/groq.md) |
| 15 | [Unsloth AI](https://openaitools.app/tool/unsloth-ai) | 887,457 | -17.6% | Free | Open-source, memory-efficient fine-tuning and local model running | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/unsloth-ai.md) |
| 16 | [Agenta](https://openaitools.app/tool/agenta) | 45,760 | +29.5% | Freemium | Open-source workspace for building, evaluating and shipping AI agents | keywords 100%; semantic match | [.md](https://openaitools.app/tool/agenta.md) |
| 17 | [Respan](https://openaitools.app/tool/respan) | 91,503 | -14.5% | Freemium | Open-source AI gateway with observability and evals built in | keywords 100%; semantic match | [.md](https://openaitools.app/tool/respan.md) |
| 18 | [Open WebUI](https://openaitools.app/tool/open-webui) | 804,534 | -2.8% | Freemium | Self-hosted AI workspace for local and cloud models | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/open-webui.md) |
| 19 | [Athena Desktop](https://openaitools.app/tool/athena-desktop) | 1,873,747 | +2,729.7% | Free | Local-first desktop workspace and orchestration layer for AI coding agents | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/athena-desktop.md) |
| 20 | [Fireworks](https://openaitools.app/tool/fireworks-ai) | 659,687 | +6% | Contact for Pricing | Run, ensemble and train open AI models as your own specialized intelligence | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/fireworks-ai.md) |
| 21 | [LiteLLM](https://openaitools.app/tool/litellm) | 576,967 | +7.9% | Freemium, Contact for Pricing | One open-source AI gateway for 100+ LLM providers | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/litellm.md) |
| 22 | [CanIRun.ai](https://openaitools.app/tool/canirun-ai) | 284,892 | -20.1% | Free | Check which local AI models your GPU or Mac can actually run | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/canirun-ai.md) |
| 23 | [Models.dev](https://openaitools.app/tool/models-dev) | 200,451 | -3.9% | Free | Open-source database of AI models, prices and capabilities | category: open-source-ai-models; keywords 57%; semantic match | [.md](https://openaitools.app/tool/models-dev.md) |
| 24 | [Mastra](https://openaitools.app/tool/mastra) | 318,954 | -5% | Freemium, Contact for Pricing | The TypeScript framework for building, deploying, and observing AI agents | keywords 100%; semantic match | [.md](https://openaitools.app/tool/mastra.md) |

Page 1 of 39 · [Next page →](https://openaitools.app/index.md?q=Open-source+evaluation&page=2)

For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`.

---
Source: https://openaitools.app/?q=Open-source%20evaluation

More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)