# AI tools for “Local inference” 360 matching tools; showing 24, ranked by relevance. | # | Tool Name | Monthly Visits | MoM Growth Rate | Pricing Model | Summary | Why it matched | Profile (Markdown) | | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | | 1 | [oMLX](https://openaitools.app/tool/omlx-ai) | 107,331 | -27.5% | Free | Native macOS inference server that makes local LLMs instant for coding agents | keywords 100%; semantic match | [.md](https://openaitools.app/tool/omlx-ai.md) | | 2 | [Unsloth AI](https://openaitools.app/tool/unsloth-ai) | 887,457 | -17.6% | Free | Open-source, memory-efficient fine-tuning and local model running | keywords 100%; semantic match | [.md](https://openaitools.app/tool/unsloth-ai.md) | | 3 | [Groq](https://openaitools.app/tool/groq) | 3,987,936 | +10% | Paid | Ultra-fast AI inference on the LPU and LPX platform | keywords 59%; semantic match | [.md](https://openaitools.app/tool/groq.md) | | 4 | [local.ai](https://openaitools.app/tool/local-ai) | 6,014 | +8.6% | Free | Run AI models offline with a free, open-source desktop playground | keywords 100%; semantic match | [.md](https://openaitools.app/tool/local-ai.md) | | 5 | [Ollama](https://openaitools.app/tool/ollama) | 9,421,973 | +4.3% | Free, Freemium, Paid | Run and build with open AI models locally or in the cloud | semantic match | [.md](https://openaitools.app/tool/ollama.md) | | 6 | [Qwen 4 (Alibaba Qwen4)](https://openaitools.app/tool/qwen-4) | 35,101,353 | -6.2% | Freemium | Alibaba Cloud's 4th-generation multimodal AI assistant and foundation model lineup (Qwen4-Max, Qwen4-Plus, Qwen4-Flash & open-weight Qwen4-27B) with 1M context. | keywords 100% | [.md](https://openaitools.app/tool/qwen-4.md) | | 7 | [TypeSafe AI - Jev](https://openaitools.app/tool/typesafe-jev) | 6,148,688 | -36.4% | Paid | Machine-native AI that returns typed, calibrated decisions for software automation | keywords 59%; semantic match | [.md](https://openaitools.app/tool/typesafe-jev.md) | | 8 | [Together AI](https://openaitools.app/tool/together-ai) | 1,645,930 | +64.9% | Freemium, Paid | Together AI is the AI Native Cloud — a full-stack platform for running, fine-tuning and training open-source models. It spans serverless inference APIs, dedicated endpoints, GPU clusters, post-training and storage, all b | keywords 59%; semantic match | [.md](https://openaitools.app/tool/together-ai.md) | | 9 | [Modal](https://openaitools.app/tool/modal-com) | 1,196,021 | +30.2% | Freemium, Contact for Pricing | Serverless cloud infrastructure for AI and data workloads | keywords 59%; semantic match | [.md](https://openaitools.app/tool/modal-com.md) | | 10 | [Gemma Open Models by Google](https://openaitools.app/tool/gemma-open-models-by-google) | 4,900,914 | -13.5% | Freemium, Paid | Google's family of lightweight, open-weight AI models | semantic match | [.md](https://openaitools.app/tool/gemma-open-models-by-google.md) | | 11 | [DeepInfra](https://openaitools.app/tool/deep-infra) | 457,810 | -8.9% | Paid | Low-cost serverless inference APIs for 200+ open models | keywords 59%; semantic match | [.md](https://openaitools.app/tool/deep-infra.md) | | 12 | [BLACKBOX.AI](https://openaitools.app/tool/blackbox-ai-1) | 622,975 | -27.2% | Free Trial, Paid | High-trust frontier inference, encrypted end to end | keywords 59%; semantic match | [.md](https://openaitools.app/tool/blackbox-ai-1.md) | | 13 | [Cerebras](https://openaitools.app/tool/cerebras) | 701,013 | -12.6% | Contact for Pricing | The world's fastest AI inference, powered by the world's biggest chip | keywords 59%; semantic match | [.md](https://openaitools.app/tool/cerebras.md) | | 14 | [Morph](https://openaitools.app/tool/morph-apply-ai-edits-to-files-fast) | 306,961 | +9.5% | Free Trial, Contact for Pricing | Fast Apply and agent-tuned inference for coding agents | keywords 59%; semantic match | [.md](https://openaitools.app/tool/morph-apply-ai-edits-to-files-fast.md) | | 15 | [Fireworks](https://openaitools.app/tool/fireworks-ai) | 659,687 | +6% | Contact for Pricing | Run, ensemble and train open AI models as your own specialized intelligence | keywords 59%; semantic match | [.md](https://openaitools.app/tool/fireworks-ai.md) | | 16 | [Atlas Cloud](https://openaitools.app/tool/atlas-cloud) | 777,031 | -16.4% | Paid | One OpenAI-compatible API for 500+ image, video, audio, and LLM models | keywords 59% | [.md](https://openaitools.app/tool/atlas-cloud.md) | | 17 | [Salad](https://openaitools.app/tool/salad-gpu-cloud) | 713,519 | +10.4% | Free Trial, Paid, Contact for Pricing | Distributed GPU cloud that orchestrates the world's idle consumer GPUs | keywords 59% | [.md](https://openaitools.app/tool/salad-gpu-cloud.md) | | 18 | [OpenRouter](https://openaitools.app/tool/openrouter-ai) | 19,941,437 | -6.2% | Paid | One API key for hundreds of AI models from every major provider | keywords 59% | [.md](https://openaitools.app/tool/openrouter-ai.md) | | 19 | [Clipto](https://openaitools.app/tool/clipto-com) | 1,857,276 | +10.9% | Free Trial, Paid | Local-first AI memory that makes your videos, audio and documents searchable | semantic match | [.md](https://openaitools.app/tool/clipto-com.md) | | 20 | [SiliconFlow](https://openaitools.app/tool/siliconflow) | 276,303 | -10.5% | Pay-as-you-go | One API for fast, cost-predictable inference on LLMs and multimodal models | keywords 59%; semantic match | [.md](https://openaitools.app/tool/siliconflow.md) | | 21 | [AnythingLLM](https://openaitools.app/tool/anythingllm) | 512,269 | +12.9% | Freemium | Own your intelligence: a private AI assistant that runs entirely on your machine | semantic match | [.md](https://openaitools.app/tool/anythingllm.md) | | 22 | [LM-Kit.NET](https://openaitools.app/tool/lm-kit-net) | 11,445 | -18% | Freemium, Free Trial, Paid | Embed private generative AI, RAG and agents directly inside your .NET application | keywords 100%; semantic match | [.md](https://openaitools.app/tool/lm-kit-net.md) | | 23 | [Open WebUI](https://openaitools.app/tool/open-webui) | 804,534 | -2.8% | Freemium | Self-hosted AI workspace for local and cloud models | semantic match | [.md](https://openaitools.app/tool/open-webui.md) | | 24 | [Chutes](https://openaitools.app/tool/chutes) | 250,187 | -15.2% | Paid | Serverless, decentralized inference for open-source AI models | keywords 59%; semantic match | [.md](https://openaitools.app/tool/chutes.md) | Page 1 of 15 · [Next page →](https://openaitools.app/index.md?q=Local+inference&page=2) For programmatic access use `https://openaitools.app/api/tools?q=…` or MCP `https://openaitools.app/api/mcp`. --- Source: https://openaitools.app/?q=Local%20inference More Markdown: [Categories](https://openaitools.app/categories.md) · [Traffic rankings](https://openaitools.app/rankings.md) · [llms.txt](https://openaitools.app/llms.txt)