AI gateway, observability and guardrails for production LLM apps
Compare AI products across 459 workflows using traffic estimates, features, and alternatives.

“Prompt caching” · Coding & Development·28 results
Start overAI gateway, observability and guardrails for production LLM apps
Open-source LLM observability and AI gateway for shipping reliable AI apps
Open-source LLM observability and AI gateway for shipping reliable AI apps

Native macOS inference server that makes local LLMs instant for coding agents
Native macOS inference server that makes local LLMs instant for coding agents

Cut AI agent token costs with recoverable context compression and smart model routing
Cut AI agent token costs with recoverable context compression and smart model routing
One OpenAI-compatible API to route, monitor and control 250+ LLM models
One OpenAI-compatible API to route, monitor and control 250+ LLM models

Open models served fast, with warm-cache routing for agents
Open models served fast, with warm-cache routing for agents
Free, community-curated AI prompt library for ChatGPT, Claude and Gemini
Free, community-curated AI prompt library for ChatGPT, Claude and Gemini

High-throughput open-weight inference with latency-based pricing
High-throughput open-weight inference with latency-based pricing

Open-source Rust coding agents for your terminal, built for parallelism

AI control plane for LLM routing, observability and FinOps
Capture and inspect every LLM API call from a local web UI
Build, run and manage AI agents — visually or in code
An autonomous AI agent that writes, runs, and verifies Excel formulas, VBA, and Python inside your workbook
An autonomous AI agent that writes, runs, and verifies Excel formulas, VBA, and Python inside your workbook

Open-source AI gateway for LLM APIs, agents and MCP servers

Open-source integration layer that gives AI agents secure, multi-tenant access to 400+ apps
Open-source integration layer that gives AI agents secure, multi-tenant access to 400+ apps

Open-source agentic IDE for orchestrating coding agents
The AI orchestration layer that turns LLM experiments into reliable production workflows

Save, cache and actually understand what you read.

Open-source distributed LLM inference orchestration for your own fleet
Manage, test, and track AI prompts with one API key
Save, organise and share your AI prompts in one place
Save, organise and share your AI prompts in one place
Optimize, secure, and generate web images from one platform.
Optimize, secure, and generate web images from one platform.
A structured system for organizing, versioning, and scaling your prompt library
A structured system for organizing, versioning, and scaling your prompt library
The open-source prompt library that started it all