llm-gateway

A real FastAPI application, handling real requests — in this tab. Auth, per-key rate limiting, response caching, retries and cost accounting all execute exactly as they do in production. Hit the buttons and watch the middleware actually work.