Providers
Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.
| Provider | Context | Max output | Latency | Throughput | Input | Output | Cache | Capabilities | ZDR | No training | Regions | Status |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1M | 128K | 0.8 s | 69 tps | $1.40 | $4.40 | Read $0.28Write — | 5 features | Yes | Yes | Global | Certified | |
| 1M | 128K | 0.3 s | 339 tps | $1.68 | $5.28 | Read $0.31Write $2.10 | 6 features | Yes | Yes | US | Listed | |
| 1M | 1M | 1.5 s | 122 tps | $1.40 | $4.40 | Read $0.14Write — | 5 features | Yes | Yes | US | Certified | |
| 1.05M | 1.05M | 0.4 s | 287 tps | $1.12 | $3.52 | Read $0.14Write — | 4 features | No | No | Global | Certified | |
| 1.05M | 1.05M | 15.4 s | 204 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | No | No | Global | Certified | |
| 1.05M | 1.05M | 0.9 s | 93 tps | $0.56 | $2.50 | Read $0.13Write — | 5 features | No | Yes | Global | Certified | |
| 1.05M | 1.05M | 0.2 s | 263 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | Yes | Yes | Global | Certified | |
| 1M | 262K | 0.3 s | 126 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | Yes | Yes | US | Certified | |
| 1M | 1M | 0.2 s | 112 tps | $1.26 | $3.96 | Read $0.23Write — | 5 features | No | No | Global | Certified | |
| 1.05M | 1.05M | 1.3 s | 95 tps | $0.70 | $2.20 | Read $0.13Write — | 5 features | No | No | Global | Certified | |
| 1.05M | 1.05M | 0.5 s | 202 tps | $1.25 | $4.40 | Read $0.26Write — | 5 features | No | Yes | Global | Certified | |
| 1M | 131K | 0.4 s | 158 tps | $0.90 | $3.00 | Read $0.15Write — | 5 features | No | No | Global | Certified | |
| 1M | 1M | 2.9 s | 218 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | Yes | Yes | Global | Certified | |
| 1.05M | 1.05M | 0.4 s | 72 tps | $0.74 | $3.00 | Read $0.25Write — | 5 features | Yes | Yes | Global | Listed | |
| 1M | 128K | 0.9 s | 190 tps | $0.91 | $2.86 | Read $0.17Write — | 5 features | No | No | Global | Listed | |
| 1M | 1M | 1.6 s | 270 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | Yes | Yes | Global | Certified | |
| 1.05M | 131K | 3.1 s | 121 tps | $0.070 | $4.38 | Read $0.070Write — | 4 features | Yes | Yes | Global | Certified | |
| 1.05M | 1.05M | 0.4 s | 151 tps | $1.04 | $3.36 | Read $0.10Write — | 5 features | No | No | Global | Listed | |
| 1.05M | 1.05M | 0.8 s | 165 tps | $1.73 | $5.79 | Read $0.31Write — | 5 features | Yes | Yes | Global | Certified | |
| 1.05M | 1.05M | 0.4 s | 154 tps | $0.98 | $3.08 | Read $0.18Write — | 5 features | No | No | Global | Listed | |
| 1.02M | 128K | 1.1 s | 111 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | No | No | Global | Certified | |
| 1M | 128K | 0.3 s | 178 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | No | No | Global | Listed | |
| 1.05M | 1.05M | 1.6 s | 55 tps | $1.25 | $4.00 | Read $0.24Write — | 5 features | No | No | Global | Listed | |
| 1M | 128K | 1.7 s | 30 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | No | No | Global | Listed | |
| 1M | 1M | 0.5 s | 117 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | Yes | Yes | Global | Certified | |
| 1.05M | 1.05M | 0.3 s | — | $0.18 | $1.40 | Read $0.18Write — | 5 features | Yes | Yes | US | Certified | |
| 1M | 128K | 1.1 s | 99 tps | $1.40 | $4.40 | Read $0.26Write — | 5 features | No | No | Global | Certified |
Uptime
24 hoursRequest success rate per provider.
Throughput
last hourP50 output tokens per second.
Latency
last hourP50 time to first token.
Getting started
Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.inferencebureau.com/v1",
apiKey: process.env.IB_API_KEY,
});
const res = await client.chat.completions.create({
model: "zai/glm-5.3",
messages: [{ role: "user", content: "Why is the sky blue?" }],
});
console.log(res.choices[0].message.content);Top-level parameters
Standard Chat Completions parameters work as documented. These have model-specific behavior.
| Parameter | Type | Required | Description |
|---|---|---|---|
model | string | Yes | Model ID in the form creator/model, e.g. zai/glm-5.3. Must be allowed by your team's Directives. |
max_tokens | number | No | Hard cap on generated tokens, and the basis for the balance reserved per request. GLM 5.3 supports up to 1,000,000 output tokens. |
reasoning | { effort: 'low' | 'medium' | 'high' } | No | Reasoning effort, mapped to the provider's native configuration. Reasoning tokens count toward output usage. |
tools | Tool[] | No | Function definitions the model can call. Tool calls are returned in choices[].message.tool_calls. |
Supported
max_tokenstemperaturestoptoolstool_choicereasoninginclude_reasoningresponse_formatstructured_outputsInput limits
| Input | Sources | Limits |
|---|---|---|
| Text | — | Prompt and response share the 1M-token context window |
More models by zai
| Model | Context | Input | Output | Cache | Release |
|---|---|---|---|---|---|
| 1M | $0.37 | $1.25 | Read $0.075Write — | 11/02/2026 | |
| 1M | $0.37 | $1.25 | Read $0.075Write — | 09/18/2026 | |
| 1.05M | $2.10 | $6.60 | Read $0.21Write — | 09/02/2026 | |
| 1M | $0.15 | $0.50 | Read $0.030Write — | 08/26/2026 | |
| 1M | $2.80 | $8.80 | Read $0.56Write — | 06/23/2026 | |
| 1M | $1.40 | $4.40 | Read $0.14Write — | 06/16/2026 | |
| 203K | $1.40 | $4.40 | Read $0.26Write — | 04/07/2026 | |
| 200K | $1.20 | $4.00 | Read $0.24Write — | 04/01/2026 | |
| 203K | $1.20 | $4.00 | Read $0.24Write — | 03/15/2026 | |
| 203K | $1.00 | $3.20 | Read —Write — | 02/12/2026 |