Newmoonshotai/kimi-k3-ultrafast

One API for every LLM, built for production

Route OpenAI, Anthropic, Google, and Azure through a single OpenAI-compatible endpoint. Keep the SDK you already use, and get automatic failover, real-time request logs, and per-model cost tracking without writing a line of glue code.

Read Docs
One key, every provider
OpenAIOpenAIAnthropicAnthropicGoogleGoogleAzureAzureGoogle VertexGoogle VertexxAIxAIMoonshot AIMoonshot AIDeepSeekDeepSeekMiniMaxMiniMaxZ.aiZ.aiAlibabaAlibabaSionic AISionic AI

Integration

One endpoint, every model you will ever need.

Point your existing OpenAI SDK at OpenGateway and switch models by changing a single string. Routing, authentication, retries, and response normalization are handled for you.

Unified JSON response format
Automatic retries & backoff
Detailed usage analytics dashboard
completion.ts
1import OpenAI from 'openai';
2
3const client = new OpenAI({
4 baseURL: 'https://apis.opengateway.ai/v1',
5 apiKey: process.env.OPENGATEWAY_API_KEY,
6});
7
8const res = await client.chat.completions.create({
9 model: 'openai/gpt-4o',
10 messages: [{ role: 'user', content: 'Hello!' }],
11});
12
13// response follows OpenAI SDK format
14console.log(res.choices[0].message.content);
Observe

Debug LLM calls while they are still in flight

A Grafana-style Live Tail, label filters for status, provider, and model, and full request/response inspection are built in—so you can see exactly what your application sent and what came back, without standing up a separate logging stack.

Live Tail streaming
Watch logs flow in real time as your application scales.
Filter by labels: status / provider / model
Drill down into errors or specific request patterns.
Inspect latency, tokens, and cost
Full observability and cost attribution per request.
LIVE TAIL
status:all
Streaming
TimeStatusProviderModelTokensCostLatency
15:32:01200openaigpt-4o1,234$0.012245ms
15:31:58200anthropicclaude-3-sonnet856$0.009312ms
15:31:55429openaigpt-4o---
15:31:52200googlegemini-2.5-pro2,100$0.021189ms
15:31:49200openaigpt-4o-mini567$0.003156ms
Recover

Failover only on the errors that deserve it

Rate limits, 5xx responses, and timeouts are rerouted to the next model in your fallback chain automatically, while genuine client errors still come back to you as 400s. You get resilience where it helps and honest errors where it matters.

Clear triggers: 429 / 5xx / timeout
Define exactly which HTTP codes trigger a failover event.
Configurable fallback chain per request
Pass a list of fallback models via API request body.
Every failover is visible in logs
Trace exactly why a failover happened and which model responded.
Your App
openai sdk
anthropic sdk
genai sdk
azure sdk
retry x3?
429 handling
key rotation
Request failed — 429 Too Many Requests
Your App
OpenGateway
OpenAI 429
Anthropic 200
Google skip
Response returned via Anthropic (245ms)
OpenGatewayDirectSweep right →
Govern

Hand every team a key, and still keep control

Issue keys per team, scope them with Owner, Admin, and Member roles, and cap spend with prepaid credits and auto-pause. Ops and finance get a single invoice and a hard limit they can approve, instead of a dozen scattered provider accounts.

RBAC roles: Owner / Admin / Member
Granular access control for your entire organization.
Key lifecycle: Active / Suspended / Inactive
Rotate, suspend, or revoke keys instantly via API or UI.
Prepaid credits + auto-pause
Set hard limits to prevent accidental overspending.
Organization Settings
Acme Corp
Credits Balance
$2,450/ $5,000Active
API Keys
Key NameKeyStatus
Production Mainsk-prod-...k1z3Active
Dev Team Ask-dev-...m4x9Suspended
Suspend a key instantly when a project runs out of credits