nvidiaNot yet certifiedReleased 10/14/2026

Nemotron 3.5 Lightning Free

Nemotron 3.5 Lightning is an open-weight reasoning and chat model for long-running agents, sub-agent work, chatbots, and RAG systems. The model has 30B parameters with 3B active per token, in a hybrid Mixture-of-Experts design that interleaves Mamba-2 and MoE layers with a few attention layers. It has a 1M token context window and supports tool calling and structured outputs. The provider may retain prompts and responses for model improvement.

View API reference ↓
Input / output priceFrom$0 / $0per 1M
24h uptime99.95%

Listed for reference. Inference Bureau dispatches only to certified routes, so requests for this model are refused until one is certified. See certified models.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "nvidia/nemotron-3.5-lightning-free",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Providers

Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.

ProviderContextMax outputLatencyThroughputInputOutputCacheCapabilitiesZDRNo trainingRegionsStatus
nvidia1M65K0.4 s286 tps$0$0Read $0Write —5 featuresNoNoGlobalListed

Uptime

24 hours

Request success rate per provider.

nvidia99.95%

Throughput

last hour

P50 output tokens per second.

nvidia286 tps

Latency

last hour

P50 time to first token.

nvidia0.4 s

Getting started

Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "nvidia/nemotron-3.5-lightning-free",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Top-level parameters

Standard Chat Completions parameters work as documented. These have model-specific behavior.

ParameterTypeRequiredDescription
modelstringYesModel ID in the form creator/model, e.g. nvidia/nemotron-3.5-lightning-free. Must be allowed by your team's Directives.
max_tokensnumberNoHard cap on generated tokens, and the basis for the balance reserved per request. Nemotron 3.5 Lightning Free supports up to 65,000 output tokens.
reasoning{ effort: 'low' | 'medium' | 'high' }NoReasoning effort, mapped to the provider's native configuration. Reasoning tokens count toward output usage.
toolsTool[]NoFunction definitions the model can call. Tool calls are returned in choices[].message.tool_calls.
Supportedmax_tokenstemperaturestoptoolstool_choicereasoninginclude_reasoningresponse_formatstructured_outputs

Input limits

InputSourcesLimits
Text—Prompt and response share the 1M-token context window

More models by nvidia

ModelContextInputOutputCacheRelease
nvidia/nemotron-3.5-super-vl1.05M$0.20$0.50Read $0.040Write —10/15/2026
nvidia/nemotron-3.5-lightning262K$0.060$0.16Read $0.030Write —08/11/2026
nvidia/nemotron-3-ultra-550b-a55b1M$0.60$2.40Read $0.12Write —06/04/2026
nvidia/nemotron-3-super-120b-a12b256K$0.15$0.65Read —Write —03/11/2026
nvidia/nemotron-nano-12b-v2-vl131K$0.20$0.60Read —Write —10/28/2025
nvidia/nemotron-nano-9b-v2131K$0.060$0.23Read —Write —08/18/2025