
Open-source AI gateway for LLM APIs, agents and MCP servers
Compare AI products across 459 workflows using traffic estimates, features, and alternatives.

“Inference Server” · Coding & Development·285 results
Start over
Open-source AI gateway for LLM APIs, agents and MCP servers

The universal context engine connecting agents to data, tools, and models

Agent-native cloud infrastructure that lets coding agents run the whole backend stack
Reactive TypeScript backend with database, functions and AI gateway
Reactive TypeScript backend with database, functions and AI gateway
One OpenAI-compatible API to route, monitor and control 250+ LLM models
One OpenAI-compatible API to route, monitor and control 250+ LLM models
AI gateway, observability and guardrails for production LLM apps
The AI cloud built by the creators of PyTorch Lightning

Fully managed Vector Lakebase and vector database for enterprise AI, built by the creators of Milvus
Fully managed Vector Lakebase and vector database for enterprise AI, built by the creators of Milvus

One API for LLM, image, video, and audio models in production
One API for LLM, image, video, and audio models in production

Track, evaluate, and ship AI models and agents in one connected environment.
Track, evaluate, and ship AI models and agents in one connected environment.

The open-source LLM gateway that fixes your agents' requests on the fly

Expert human data and evaluation for training frontier AI

Check which local AI models your GPU or Mac can actually run
Check which local AI models your GPU or Mac can actually run

Open-source blockchain where AI models run on-chain inside smart contracts
Open-source blockchain where AI models run on-chain inside smart contracts
One REST API for LLMs, image generation and speech models
The multimodal data layer for computer vision and physical AI teams
Stream in text, code, images, voice or robot state — get decisions back as input arrives
Stream in text, code, images, voice or robot state — get decisions back as input arrives

Open-source framework and cloud for building, deploying and testing MCP servers
Open-source framework and cloud for building, deploying and testing MCP servers

A memory and continual-learning engine that gives any AI agent persistent context
A memory and continual-learning engine that gives any AI agent persistent context
The low-cost cloud sandbox where AI agents actually live
The low-cost cloud sandbox where AI agents actually live

Cloud hosting for OpenClaw, Hermes, Codex and other AI agents
Cloud hosting for OpenClaw, Hermes, Codex and other AI agents

Enterprise MCP governance for secure, cost-efficient AI agents
Enterprise-grade gateway to hundreds of AI models through one API