nvidiaCertifiedReleased 08/18/2025

Nvidia Nemotron Nano 9B V2

NVIDIA-Nemotron-Nano-9B-v2 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be controlled via a system prompt. If the user prefers the model to provide its final answer without intermediate reasoning traces, it can be configured to do so.\

View API reference ↓
Input / output priceFrom$0.060 / $0.23per 1M
24h uptime100.00%
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "nvidia/nemotron-nano-9b-v2",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Providers

Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.

ProviderContextMax outputLatencyThroughputInputOutputCacheCapabilitiesZDRNo trainingRegionsStatus
Amazon Bedrock131K131K0.2 s184 tps$0.060$0.23Read —Write —3 featuresYesYesGlobalCertified

Uptime

24 hours

Request success rate per provider.

Amazon Bedrock100.00%

Throughput

last hour

P50 output tokens per second.

Amazon Bedrock184 tps

Latency

last hour

P50 time to first token.

Amazon Bedrock0.2 s

Getting started

Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "nvidia/nemotron-nano-9b-v2",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Top-level parameters

Standard Chat Completions parameters work as documented. These have model-specific behavior.

ParameterTypeRequiredDescription
modelstringYesModel ID in the form creator/model, e.g. nvidia/nemotron-nano-9b-v2. Must be allowed by your team's Directives.
max_tokensnumberNoHard cap on generated tokens, and the basis for the balance reserved per request. Nvidia Nemotron Nano 9B V2 supports up to 131,072 output tokens.
reasoning{ effort: 'low' | 'medium' | 'high' }NoReasoning effort, mapped to the provider's native configuration. Reasoning tokens count toward output usage.
toolsTool[]NoFunction definitions the model can call. Tool calls are returned in choices[].message.tool_calls.
Supportedmax_tokenstemperaturestoptoolstool_choicereasoninginclude_reasoning

Input limits

InputSourcesLimits
Text—Prompt and response share the 131K-token context window

More models by nvidia

ModelContextInputOutputCacheRelease
nvidia/nemotron-3.5-super-vl1.05M$0.20$0.50Read $0.040Write —10/15/2026
nvidia/nemotron-3.5-lightning-free1M$0$0Read —Write —10/14/2026
nvidia/nemotron-3.5-lightning262K$0.060$0.16Read $0.030Write —08/11/2026
nvidia/nemotron-3-ultra-550b-a55b1M$0.60$2.40Read $0.12Write —06/04/2026
nvidia/nemotron-3-super-120b-a12b256K$0.15$0.65Read —Write —03/11/2026
nvidia/nemotron-nano-12b-v2-vl131K$0.20$0.60Read —Write —10/28/2025