Key takeaways
- On Oct 22, 2026, 432 of Inference Bureau's 598 certified routes were listed as not training on prompts, and 383 as zero data retention.
- Zero data retention is the stricter guarantee: every route listed with it was also listed as not training, while 49 routes were no-training only.
- The same model can qualify on one provider and not another, so the guarantee belongs to the route, not the model.
- Set data.requireZdr or data.requireNoTraining in Directives, and every request goes only to routes that qualify, with the upstream gateway told to refuse the rest.
When you send a prompt to a model, the provider that runs it decides what happens to it next. Some keep nothing once the response is sent. Some keep request data for a while, for abuse monitoring or debugging, but never train on it. Others make neither promise. The model's name tells you nothing about which applies, because the same open model is often served by a dozen providers with different terms.
Inference Bureau records two flags for every certified route, meaning one model on one provider, and routes on them when your Directives ask it to.
What the two flags mean
Both flags come from the public endpoint listing of the upstream gateway Inference Bureau sends requests through. For each model, the listing gives every provider endpoint, and for each endpoint whether it has zero data retention and whether it trains on request content.
- No training (
noTraining): the provider endpoint is listed as not training on request content. It may still keep requests for a time. - Zero data retention (
zdr): the provider endpoint is listed as keeping no request data. It is the stricter of the two. It also rules out providers that store data for a while without training on it.
These are the provider's terms as the gateway lists them. Inference Bureau does not audit providers or test what they keep. What it does is route only to the endpoints that qualify, and tell the gateway, on every request, to refuse any endpoint that doesn't.
Inference Bureau keeps no prompt or response content of its own by default. It is stored only when you turn on the Log content Directive, and never where zero data retention applies.
The numbers, by provider
The certified catalog read on Oct 22, 2026 held 598 routes: 274 models across 59 providers.
| Flag | Routes | Share |
|---|---|---|
| Zero data retention (and no training) | 383 | 64% |
| No training only | 49 | 8% |
| Neither | 166 | 28% |
No route was listed as zero data retention without also being listed as not training. So requiring ZDR is a strict subset of requiring no training.
Most providers are all or nothing. These are the providers with the most routes:
| Provider | Routes | ZDR | No training |
|---|---|---|---|
| openai | 55 | 55 | 55 |
| deepinfra | 50 | 38 | 38 |
| bedrock | 49 | 40 | 48 |
| novita | 45 | 0 | 0 |
| alibaba | 36 | 25 | 25 |
| azure | 33 | 33 | 33 |
| vertex | 26 | 26 | 26 |
| anthropic | 17 | 15 | 17 |
| 17 | 0 | 17 | |
| gmicloud | 15 | 0 | 0 |
| zai | 14 | 0 | 0 |
| baseten | 14 | 14 | 14 |
Some of the splits are worth knowing:
- Gemini on Google's own API vs Vertex. All 17 routes on
googlewere listed as not training, and none as zero data retention. The 26 routes onvertexhad both. - Anthropic. 15 of 17 routes on Anthropic's own API had both flags. The other two,
claude-fable-5andclaude-fable-5.1, were no-training only there and on Bedrock and Vertex too, so no provider offered them with ZDR. - Bedrock. 40 of 49 routes had ZDR. The nine without it were six OpenAI models, the two Fable models and
claude-sonnet-4. OpenAI's models had ZDR onopenaiandazure. - Model makers' own APIs. Several labs' first-party endpoints had neither flag on any route:
zai(14 routes),minimax(9),deepseek(4),xiaomi(5) andtencent(5). Their models are often available with ZDR from other providers.
The numbers, by model family
A model qualifies when at least one of its certified providers does. 221 of the 274 models had at least one no-training route, and 204 had at least one ZDR route. For the vendors with the most models:
| Vendor | Models | With a ZDR route | With a no-training route |
|---|---|---|---|
| openai | 64 | 64 | 64 |
| alibaba | 32 | 25 | 25 |
| 19 | 18 | 19 | |
| anthropic | 18 | 15 | 17 |
| zai | 17 | 9 | 9 |
| meta | 13 | 11 | 11 |
| deepseek | 12 | 11 | 11 |
| minimax | 9 | 3 | 3 |
| mistral | 9 | 9 | 9 |
| moonshotai | 8 | 6 | 6 |
The open-model families are where it matters which provider you land on. Take zai: of its 17 models, 9 had a ZDR route, and those 9 spread 40 ZDR routes across other providers, while Z.ai's own endpoint had none. 53 models, including moonshotai/kimi-k2 and most minimax models, had no provider listed as not training at all.
Requiring it with Directives
Set the rule in the Data group of the Directives table, at the team, a project, an environment or a key. In JSON it is the data field:
{
"data": { "requireNoTraining": true }
}
For zero data retention, set requireZdr instead. Set both to require both, though in today's catalog ZDR already implies no training:
{
"data": { "requireZdr": true, "requireNoTraining": true }
}
With the management API, change one field and keep the rest:
curl -X PATCH https://api.inferencebureau.com/v1/projects/inference-bureau/directives \
-H "Authorization: Bearer $IB_MANAGEMENT_KEY" \
-H "Content-Type: application/json" \
-d '{ "policy_version": 3, "set": { "data.requireZdr": true } }'
Here is what follows:
- Set at any level, the rule applies to everything below it and can't be lifted there. A team that requires ZDR covers every project and key.
- Providers that don't qualify are skipped, with
no_zdrorno_trainingon the request's receipt in Logs. A model with no qualifying provider returns403 policy_deniedand is left out ofGET /v1/models. - Every request also carries the gateway's own flags, which refuse a provider that doesn't qualify, so a change of terms is caught upstream as well.
- Under
requireZdr, nothing is stored on Inference Bureau's side. Stored responses on/v1/responsesare refused, and turning the rule on deletes those already stored under that level. - Under either rule,
/v1/messages/count_tokensanswers with a local estimate rather than sending the prompt to a provider.
How the flags stay current
Providers change their terms. The catalog records each route's flags when it is synced, and the counts above are from that record. Between syncs, a scheduled job at 37 minutes past every hour reads the gateway's listing for every certified model. It needs no credential and runs no inference. It stores the result as a snapshot that every process planning requests reads.
The snapshot can only take a guarantee away. If the gateway stops listing a provider as ZDR or as not training, that route stops qualifying within the hour. A newly listed provider is used only once Inference Bureau records it in the catalog. A snapshot older than 48 hours is ignored, and so is one that looks like a gateway fault: one that couldn't read more than a fifth of the models, or that would revoke more than half the guarantees at once. Planning then falls back to the catalog's own flags. The per-request flags still apply either way.
Frequently asked questions
Does Inference Bureau verify that a provider keeps nothing?
No. The flags are the provider's terms as the upstream listing gives them. Inference Bureau routes on them and asks the gateway to refuse any provider that doesn't qualify, but it does not audit providers.
Is zero data retention the same as not training on prompts?
No. No training means the provider doesn't train on request content but may keep it for a time. Zero data retention means it keeps none. In the Oct 22, 2026 catalog, every ZDR route was also listed as not training.
What happens if a model has no qualifying provider?
Requests for it return 403 policy_denied, and it is left out of GET /v1/models for keys under the rule. The model isn't swapped for another unless you set up model fallback.
Does Inference Bureau store my prompts?
Not by default. Content is kept only when the Log content Directive is on, for 7 or 30 days, and never where requireZdr applies.