Tag: ai-gateway

Showing 1-2 of 2

Jun 29, 20267 min readTooling Deep DiveIntermediate120 min build

Deploy AI-Gateway: an open-source semantic-caching reverse proxy to reduce LLM API costs

Guide to running AI-Gateway, an open-source semantic-caching reverse proxy that can cut LLM API/token costs (repo cites ~40–70%). Covers setup checklist, verification, and rollout tips.

ai-gateway semantic-caching reverse-proxy llm-api open-source

+2 more

deployment tutorial

TutorialsFrance

Open

Mar 09, 20267 min readModel Release BriefIntermediate30 min build

Styx: a self-hosted MCP-native AI gateway that auto-routes requests with styx:auto

Hands-on guide to self-hosting Styx, an MCP-native AI gateway that auto-routes requests (styx:auto) across 65+ models with live pricing. Setup, test routing, and POC tips.

styx ai-gateway mcp self-hosted auto-routing

+3 more

open-source model-routing openrouter