Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceRun and build with open AI models locally or in the cloud
EvalCore records 0 monthly visits with 0% month-over-month growth and Free pricing. Weights & Biases (CoreWeave Forge) records 315,624 monthly visits with -80.2% growth and Freemium, Contact for Pricing, Free pricing.

Snapshot testing for AI behavior — catch regressions offline in CI
| Dimension / Metric | ![]() | ![]() |
|---|---|---|
| Official Domain | evalcore.cc | wandb.ai |
| Pricing Model | Free | Freemium, Contact for Pricing, Free |
| Monthly Visits | 0 (0) | 315.62K (315,624) |
| MoM Traffic Delta | 0 (0%) | -1.28M (-80.2%) |
| Primary Market & Share | 🌐 Global (—) | 🇺🇸 United States (32.2%) |
| Direct Visits / mo | 0 | 230.88K |
| User Rating | 4.8 | 4.7 |
| Supported Platforms | Website | Website |

Snapshot testing for AI behavior — catch regressions offline in CI
A live run captures every model request and response into a local SQLite cassette that CI can replay offline and deterministically at zero cost.
Point EvalCore at OpenAI-compatible endpoints, vLLM, Ollama, your own REST APIs, shell commands, or OTel/OpenInference traces — no SDK required.
Stack contains, judge-rubric and other scorers in YAML to express exactly what a correct answer looks like for each case.
Compare against a baseline branch so only real regressions fail, and let the process exit code gate your pull requests.

Track, evaluate, and ship AI models and agents in one connected environment.
Log metrics, losses, and media from training runs and compare them side by side in interactive charts to spot what actually improves your model.
Run automated hyperparameter sweeps and visualize parameter importance so you can converge on better configurations faster.
Version datasets and model artifacts, track lineage, and promote models through a registry from training to production.
Build, log, and evaluate LLM prompts and applications, with tracing and evaluation tools grouped under an LLMOps workflow.
Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceRun and build with open AI models locally or in the cloud
GenAI-native end-to-end QA agent that plans, writes and heals tests in plain language

Free / Open-sourceProvides deep production LLM observability and tracing, focusing heavily on debugging production failures and drift.
Free / Open-sourceProvides deep production LLM observability and tracing, focusing heavily on debugging production failures and drift.

Attack-led AI security testing and red teaming
Attack-led AI security testing and red teaming

SpecialistFeatures simulation and guardrail tools for testing LLM safety and robustness before production deployment.
SpecialistFeatures simulation and guardrail tools for testing LLM safety and robustness before production deployment.

Free / Open-sourceOffers robust LLM evaluation and testing suites with integrated enterprise gateways, prioritizing prompt benchmarking.
Free / Open-sourceOffers robust LLM evaluation and testing suites with integrated enterprise gateways, prioritizing prompt benchmarking.

Free / Open-sourceOpen-source, human-readable UI testing for mobile and web
Free / Open-sourceOpen-source, human-readable UI testing for mobile and web

Focuses specifically on prompt versioning, collaborative CMS management, and agent tracing rather than general MLOps.
Focuses specifically on prompt versioning, collaborative CMS management, and agent tracing rather than general MLOps.

Specializes in automated LLM unit testing and security red-teaming, though less focused on traditional MLOps experiment tracking.
Specializes in automated LLM unit testing and security red-teaming, though less focused on traditional MLOps experiment tracking.
AI governance, testing, and observability for regulated enterprises
AI governance, testing, and observability for regulated enterprises

Free / Open-sourceProvides an open-source workspace specifically for prompt experimentation, LLM evaluation, and agent deployment pipelines.
Free / Open-sourceProvides an open-source workspace specifically for prompt experimentation, LLM evaluation, and agent deployment pipelines.