Providers
Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.
| Provider | Context | Max output | Latency | Throughput | Input | Output | Cache | Capabilities | ZDR | No training | Regions | Status |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 262K | 0 | — | — | $0.100 | $0 | Read —Write — | 2 features | No | Yes | Global | Listed |
Uptime
24 hoursRequest success rate per provider.
Getting started
Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.
const res = await fetch("https://api.inferencebureau.com/v1/evaluate", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.IB_API_KEY}`,
"Content-Type": "application/json",
},
body: JSON.stringify({
"model": "google/gemini-decision-1",
"state": { "review": "Arrived early, works great." },
"questions": {
"sentiment": {
"type": "choice",
"instructions": "Overall sentiment of the review?",
"criteria": { "positive": "Favorable", "negative": "Unfavorable" }
}
}
}),
});
const { answers } = await res.json();
console.log(answers.sentiment.choice, answers.sentiment.confidence);Gemini Decision 1 answers POST /v1/evaluate, not chat completions. It is billed on input tokens only.