# AI tools for “Low-latency LLM API”

600 matching tools; showing 24, ranked by relevance.

Related categories: [ai-models](https://openaitools.app/category/ai-models.md), [ai-api](https://openaitools.app/category/ai-api.md)

| # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
| 1 | [Groq](https://openaitools.app/tool/groq) | 3,987,936 | +10% | Paid | Ultra-fast AI inference on the LPU and LPX platform | category: ai-api; keywords 100%; semantic match | [.md](https://openaitools.app/tool/groq.md) |
| 2 | [DeepSeek](https://openaitools.app/tool/deepseek) | 372,761,591 | +4.3% | Freemium | High-efficiency open-weight and hosted reasoning AI powered by DeepSeek-V4 and R1 at ultra-low token costs. | category: ai-api; keywords 58%; semantic match | [.md](https://openaitools.app/tool/deepseek.md) |
| 3 | [OpenAI Platform](https://openaitools.app/tool/openai) | 234,678,639 | -9.6% | Paid | Enterprise developer platform and API for deploying GPT-6 Astra, Sol, Luna, and realtime multimodal agents. | category: ai-models, ai-api; semantic match | [.md](https://openaitools.app/tool/openai.md) |
| 4 | [Cartesia](https://openaitools.app/tool/cartesia-ai) | 1,782,707 | +49.7% | Contact for Pricing | Real-time voice AI models and agents you can build on | category: ai-api; keywords 89%; semantic match | [.md](https://openaitools.app/tool/cartesia-ai.md) |
| 5 | [OpenRouter](https://openaitools.app/tool/openrouter-ai) | 19,941,437 | -6.2% | Paid | One API key for hundreds of AI models from every major provider | category: ai-models, ai-api; semantic match | [.md](https://openaitools.app/tool/openrouter-ai.md) |
| 6 | [AI/ML API](https://openaitools.app/tool/ai-ml-api) | 232,946 | -20.1% | Pay-as-you-go credits (free to start); enterprise custom pricing on request | One universal API for 500+ AI models and 1,000+ agentic tools | category: ai-models, ai-api; keywords 100%; semantic match | [.md](https://openaitools.app/tool/ai-ml-api.md) |
| 7 | [Video SDK](https://openaitools.app/tool/video-sdk) | 125,669 | -28.3% | Freemium, Paid, Contact for Pricing | Low-latency video, voice and AI-agent APIs for developers | category: ai-api; keywords 100%; semantic match | [.md](https://openaitools.app/tool/video-sdk.md) |
| 8 | [DeepInfra](https://openaitools.app/tool/deep-infra) | 457,810 | -8.9% | Paid | Low-cost serverless inference APIs for 200+ open models | category: ai-models, ai-api; keywords 58%; semantic match | [.md](https://openaitools.app/tool/deep-infra.md) |
| 9 | [Doubleword](https://openaitools.app/tool/doubleword) | 21,405 | -56.3% | Paid, Contact for Pricing | High-throughput open-weight inference with latency-based pricing | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/doubleword.md) |
| 10 | [ZenMux](https://openaitools.app/tool/zenmux) | 444,394 | +16.7% | Freemium, Paid | One unified API for 100+ AI models, with insurance when output disappoints | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/zenmux.md) |
| 11 | [Qwen 4 (Alibaba Qwen4)](https://openaitools.app/tool/qwen-4) | 35,101,353 | -6.2% | Freemium | Alibaba Cloud's 4th-generation multimodal AI assistant and foundation model lineup (Qwen4-Max, Qwen4-Plus, Qwen4-Flash & open-weight Qwen4-27B) with 1M context. | category: ai-models, ai-api; semantic match | [.md](https://openaitools.app/tool/qwen-4.md) |
| 12 | [TypeSafe AI - Jev](https://openaitools.app/tool/typesafe-jev) | 6,148,688 | -36.4% | Paid | Machine-native AI that returns typed, calibrated decisions for software automation | category: ai-models; keywords 100% | [.md](https://openaitools.app/tool/typesafe-jev.md) |
| 13 | [Gradium](https://openaitools.app/tool/gradium) | 126,416 | +128.7% | Freemium, Contact for Pricing | Real-time voice AI APIs with 50 ms to first audio | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/gradium.md) |
| 14 | [Octen](https://openaitools.app/tool/octen) | 11,653 | +7.6% | Free Trial, Paid | Real-time web search and retrieval APIs built for AI agents | category: ai-api; keywords 100%; semantic match | [.md](https://openaitools.app/tool/octen.md) |
| 15 | [Deepgram Voice AI](https://openaitools.app/tool/deepgram-voice-ai) | 863,852 | +31.8% | Free Trial | Real-time speech-to-text, text-to-speech and voice agents in one API platform | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/deepgram-voice-ai.md) |
| 16 | [Gemma Open Models by Google](https://openaitools.app/tool/gemma-open-models-by-google) | 4,900,914 | -13.5% | Freemium, Paid | Google's family of lightweight, open-weight AI models | category: ai-models; semantic match | [.md](https://openaitools.app/tool/gemma-open-models-by-google.md) |
| 17 | [Portkey](https://openaitools.app/tool/portkey-ai) | 195,650 | -9.4% | Freemium, Paid, Contact for Pricing | AI gateway, observability and guardrails for production LLM apps | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/portkey-ai.md) |
| 18 | [Unsloth AI](https://openaitools.app/tool/unsloth-ai) | 887,457 | -17.6% | Free | Open-source, memory-efficient fine-tuning and local model running | category: ai-models; semantic match | [.md](https://openaitools.app/tool/unsloth-ai.md) |
| 19 | [Soniox](https://openaitools.app/tool/soniox) | 335,647 | +2.2% | Paid | One speech AI API for recognition, generation, and translation in 60+ languages | category: ai-api; keywords 90%; semantic match | [.md](https://openaitools.app/tool/soniox.md) |
| 20 | [Pinecone](https://openaitools.app/tool/pinecone) | 286,732 | -31% | Freemium, Paid, Contact for Pricing | The managed vector database and knowledge engine for production AI | category: ai-api; keywords 79%; semantic match | [.md](https://openaitools.app/tool/pinecone.md) |
| 21 | [LiteLLM](https://openaitools.app/tool/litellm) | 576,967 | +7.9% | Freemium, Contact for Pricing | One open-source AI gateway for 100+ LLM providers | category: ai-api; semantic match | [.md](https://openaitools.app/tool/litellm.md) |
| 22 | [OrcaRouter](https://openaitools.app/tool/orcarouter) | 975,300 | -5.2% | Freemium | One OpenAI-compatible gateway for adaptive LLM routing, guardrails, and spend control | category: ai-api; semantic match | [.md](https://openaitools.app/tool/orcarouter.md) |
| 23 | [BytePlus](https://openaitools.app/tool/byteplus) | 3,036,127 | -30% | Freemium, Paid | AI-native cloud for building and scaling enterprise AI | category: ai-models, ai-api; semantic match | [.md](https://openaitools.app/tool/byteplus.md) |
| 24 | [Boson AI](https://openaitools.app/tool/boson-ai) | 25,614 | -25.7% | Free Trial, Paid | Speech-to-speech foundation models and real-time voice agents for business | category: ai-api; keywords 89%; semantic match | [.md](https://openaitools.app/tool/boson-ai.md) |

Page 1 of 25 · [Next page →](https://openaitools.app/index.md?q=Low-latency+LLM+API&page=2)

For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`.

---
Source: https://openaitools.app/?q=Low-latency%20LLM%20API

More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)
