Cost per end user, and limits and budgets for each one
Name your own user on each request with the ib-user header or the user field (metadata.user_id on /v1/messages). Logs filter by it, usage export and receipts show it, the project Overview lists your top end users, and Directives can cap each end user on its own.
Directives gain an endUser group: requests and tokens per minute, requests and tokens per UTC day, and daily and monthly budgets that apply to each end user separately, so one heavy user can't use up the team's allowance or budget. endUser.required refuses requests that name no end user.
A request over an end user's limit returns 429 with X-RateLimit-Scope: end_user; one over an end user's budget returns 402 budget_exceeded. Other end users are unaffected.
The end user is recorded by Inference Bureau and never forwarded upstream. GET /v1/usage filters by end_user.
More in End users and tags.