Overview
The AI Gateway is an OpenAI-compatible proxy that sits between your application and LLM providers. Send requests to a single endpoint and CloudVera handles provider routing, security scanning, caching, cost tracking, and failover — all at the edge with sub-20ms overhead.
Features
OpenAI-Compatible API
Drop-in replacement for the OpenAI SDK. Change your base URL and you're done. Works with any OpenAI-compatible client library.
Automatic Provider Detection
CloudVera detects the correct provider from the model name. Send "claude-sonnet-4" and it routes to Anthropic. Send "gemini-2.5-pro" and it routes to Google.
Streaming Support
Full support for Server-Sent Events (SSE) streaming. Responses are streamed in real-time with the same format as native provider APIs.
Request/Response Logging
Every request is logged with full metadata: model, tokens, latency, cost, provider, and security scan results. Searchable and filterable in the dashboard.