One API for every LLM
built for production
Connect OpenAI, Claude, Gemini, and Azure through an OpenAI-compatible endpoint, with automatic failover, real-time logs, and cost tracking.
IntegrationOne endpoint.
One endpoint.
Infinite possibilities.
Switch between models instantly without changing a single line of your application code. OpenGateway handles the routing, auth, and normalization.
Unified JSON response format
Automatic retries & backoff
Detailed usage analytics dashboard
completion.ts
1import OpenAI from 'openai';23const client = new OpenAI({4 baseURL: 'https://api.opengateway.ai/v1',5 apiKey: process.env.OG_API_KEY,6});78const res = await client.chat.completions.create({9 model: 'openai/gpt-4o',10 messages: [{ role: 'user', content: 'Hello!' }],11});1213// response follows OpenAI SDK format14console.log(res.choices[0].message.content);Production Ops
Debug LLM calls in real time
Grafana-style Live Tail, label filters, and request/response inspection—built in.
Live Tail streaming
Watch logs flow in real time as your application scales.
Filter by labels: status / provider / model
Drill down into errors or specific request patterns.
Inspect latency, tokens, and cost
Full observability and cost attribution per request.
LIVE TAIL
status:all
Streaming
TimeStatusProviderModelTokensCostLatency
15:32:01200openaigpt-4o1,234$0.012245ms
15:31:58200anthropicclaude-3-sonnet856$0.009312ms
15:31:55429openaigpt-4o---
15:31:52200googlegemini-2.5-pro2,100$0.021189ms
15:31:49200openaigpt-4o-mini567$0.003156ms
Failover only on the errors that matter.
Automatically reroute on 429, 5xx, and timeouts—return 400s as is (no surprises).
Clear triggers: 429 / 5xx / timeout
Define exactly which HTTP codes trigger a failover event.
Configurable fallback chain per request
Pass a list of fallback models via API request body.
Every failover is visible in logs
Trace exactly why a failover happened and which model responded.
Your App
OpenGatewayOpenAI429
Anthropic200
Googleskip
Response returned via Anthropic (245ms)
Give teams keys—keep control.
Centralized API keys, RBAC, and prepaid credits that ops & finance can approve.
RBAC roles: Owner / Admin / Member
Granular access control for your entire organization.
Key lifecycle: Active / Suspended / Inactive
Rotate, suspend, or revoke keys instantly via API or UI.
Prepaid credits + auto-pause
Set hard limits to prevent accidental overspending.
Organization Settings
Acme CorpCredits Balance
$2,450/ $5,000Active
API Keys
Key NameKeyStatus
Production Mainsk-prod-...k1z3Active
Dev Team Ask-dev-...m4x9Suspended
Suspend a key instantly when a project runs out of credits