Groq records 3,987,936 monthly visits with +10% month-over-month growth and Paid pricing. RightNow Inference (RunInfra) records 18,110 monthly visits with -22.6% growth and Free Trial, Paid, Contact for Pricing pricing.
Ultra-fast AI inference on the LPU and LPX platform
Open models served fast, with warm-cache routing for agents
| Dimension / Metric | | |
|---|---|---|
| Official Domain | groq.com | runinfra.ai |
| Pricing Model | Paid | Free Trial, Paid, Contact for Pricing |
| Monthly Visits | 3.99M (3,987,936) | 18.11K (18,110) |
| MoM Traffic Delta | +362.74K (+10%) | -5.28K (-22.6%) |
| Primary Market & Share | 🇮🇳 India (19.3%) | 🇮🇳 India (48.4%) |
| Direct Visits / mo | 1.7M | 7.78K |
| User Rating | 4.7 | 4.4 |
| Supported Platforms | Website | Website |
Ultra-fast AI inference on the LPU and LPX platform
Custom accelerators designed specifically for inference rather than training, tuned for very low latency.
Hosted access to popular open models including Llama, Mixtral, Gemma, and Whisper speech models.
An API broadly compatible with common OpenAI-style request formats for quick integration.
Automatic speech recognition with Whisper plus text-to-speech capabilities for voice applications.
Open models served fast, with warm-cache routing for agents
Automatically keeps repeated calls from one agent session on the replica that already holds its context, reaching reported cache-hit rates around 99% and cutting effective input costs.
One API key works with both the OpenAI and Anthropic SDKs, so existing agent code can switch providers with minimal changes.
Serves open-weight models with published pricing, tool calling, JSON mode, streaming and image-input capabilities, plus live output-speed and cache metrics.
Cache hits appear in usage and are billed at the cached rate, with a published measurement methodology and per-model effective input rates.
Free / Open-sourceHigh-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs.
Free / Open-sourceHigh-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs.
SpecialistProprietary frontier models with powerful reasoning and multimodal features, but lacking open-weight model hosting and custom inference speeds.
SpecialistProprietary frontier models with powerful reasoning and multimodal features, but lacking open-weight model hosting and custom inference speeds.
SpecialistGoogle's rapid prototyping IDE and developer API workbench for building multimodal applications with Gemini models.
SpecialistGoogle's rapid prototyping IDE and developer API workbench for building multimodal applications with Gemini models.
Unified API gateway aggregating hundreds of models across providers, but acting as a router rather than direct hardware host.
Unified API gateway aggregating hundreds of models across providers, but acting as a router rather than direct hardware host.
Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceRun and build with open AI models locally or in the cloud
Free / Open-sourceGoogle's family of lightweight, open-weight AI models
Free / Open-sourceGoogle's family of lightweight, open-weight AI models
Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all backed by in-house systems research.
Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all backed by in-house systems research.
One OpenAI-compatible gateway for adaptive LLM routing, guardrails, and spend control
One OpenAI-compatible gateway for adaptive LLM routing, guardrails, and spend control
Wafer-scale hardware cloud delivering ultra-fast token generation speeds comparable to Groq, but supporting a more specialized model catalog.
Wafer-scale hardware cloud delivering ultra-fast token generation speeds comparable to Groq, but supporting a more specialized model catalog.
High-throughput serverless inference for open models, featuring excellent speed and fine-tuning capabilities with broad API compatibility.
Low-cost serverless inference APIs for 200+ open models
One API for fast, cost-predictable inference on LLMs and multimodal models
One API for fast, cost-predictable inference on LLMs and multimodal models
