Response Headers

CloudVera adds metadata headers to every response. Use these for debugging, monitoring, and cost tracking. All headers are exposed via CORS for browser-based applications.

HeaderExample ValueDescription
X-Request-IDreq_a1b2c3d4Unique request ID — use this when contacting support or searching logs
X-Latency-Ms145Total gateway processing time in milliseconds (includes security scans)
X-Provider-Latency892Time spent waiting for the upstream LLM provider (ms)
X-CacheHIT / SEMANTIC-HIT / MISSCache status — HIT = exact match, SEMANTIC-HIT = similar query matched
X-Cache-Similarity0.9542Semantic similarity score (0-1) when cache is a semantic hit
X-Routed-Modelgpt-4o-2024-08-06Actual model ID used (may differ from requested if routed or aliased)
X-Routed-ProvideropenaiProvider that handled the request
X-Routing-ReasonFallback: anthropic circuit openWhy this provider/model was chosen (only present when routing occurred)
X-Budget-Remaining42.58Remaining budget in USD for this virtual key's current period
X-Budget-Percent-Used57Percentage of budget consumed this period
X-Budget-PeriodmonthlyBudget reset period: daily, weekly, or monthly
X-Circuit-StateclosedCircuit breaker state for the provider: closed (healthy), half-open (testing), open (unavailable)
Retry-After45Seconds until rate limit resets (only present on 429 responses)