OpenAICertifiedReleased 07/18/2024

GPT-4o mini

GPT-4o mini from OpenAI is their most advanced and cost-efficient small model. It is multi-modal (accepting text or image inputs and outputting text) and has higher intelligence than gpt-3.5-turbo but is just as fast.

View API reference ↓
Input / output priceFrom$0.15 / $0.60per 1M
24h uptime100.00%
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "openai/gpt-4o-mini",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Providers

Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.

ProviderContextMax outputLatencyThroughputInputOutputCacheCapabilitiesZDRNo trainingRegionsStatus
Azure128K16K0.9 s57 tps$0.15$0.60Read $0.075Write $06 featuresYesYesGlobalCertified
OpenAI128K16K0.6 s—$0.15$0.60Read $0.075Write $07 featuresYesYesUS EUCertified

Uptime

24 hours

Request success rate per provider.

Azure100.00%
OpenAI99.99%

Throughput

last hour

P50 output tokens per second.

Azure57 tps
OpenAI—

Latency

last hour

P50 time to first token.

OpenAI0.6 s
Azure0.9 s

Getting started

Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "openai/gpt-4o-mini",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Top-level parameters

Standard Chat Completions parameters work as documented. These have model-specific behavior.

ParameterTypeRequiredDescription
modelstringYesModel ID in the form creator/model, e.g. openai/gpt-4o-mini. Must be allowed by your team's Directives.
max_tokensnumberNoHard cap on generated tokens, and the basis for the balance reserved per request. GPT-4o mini supports up to 16,384 output tokens.
toolsTool[]NoFunction definitions the model can call. Tool calls are returned in choices[].message.tool_calls.
Supportedmax_tokenstemperaturestoptoolstool_choiceresponse_formatstructured_outputs

Input limits

InputSourcesLimits
Text—Prompt and response share the 128K-token context window
ImageURL, base64Sent as image_url content parts; counts as input tokens
PDFURL, base64Sent as file content parts; counts as input tokens

More models by OpenAI

ModelContextInputOutputCacheRelease
openai/gpt-6.1-terra1.05M$1.00$5.00Read $0.050Write $1.2510/26/2026
openai/gpt-6.1-terra-fast1.05M$2.00$10.00Read $0.100Write $2.5010/26/2026
openai/gpt-6.1-sol1.05M$2.00$10.00Read $0.100Write $2.5009/29/2026
openai/gpt-6.1-sol-batch1.05M$1.00$5.00Read $0.050Write $1.2509/29/2026
openai/gpt-6.1-sol-fast1.05M$4.00$20.00Read $0.20Write $5.0009/29/2026
openai/gpt-6-luna1.05M$0.100$0.50Read $0.010Write $0.1309/22/2026
openai/gpt-6-luna-batch1.05M$0.050$0.25Read $0.0050Write $0.06309/22/2026
openai/gpt-6-luna-fast1.05M$0.20$1.00Read $0.020Write $0.2509/22/2026
openai/gpt-6-sol1.05M$2.00$10.00Read $0.20Write $2.5009/22/2026
openai/gpt-6-sol-batch1.05M$1.00$5.00Read $0.100Write $1.2509/22/2026