Skip to main content

Overview

Nemotron 3 Ultra 550B is a 550B parameter mixture-of-experts architecture with 55B active parameters per forward pass. It combines a hybrid Mamba-Transformer design to handle reasoning, coding, and general-purpose text tasks efficiently. On Kyma, the model runs through an OpenAI-compatible endpoint with automatic request failover and exact cost reporting in the response payload. It supports tool use, structured outputs, and prompt caching, which bills repeated prefixes at this model’s cached input rate. The model accepts a 1,000,000 token context window but caps generation at 32,768 output tokens. It is strictly text-only and does not support vision or multimodal inputs.

Specs

Pricing

Use this when

  • Long Context Document Analysis — Process large technical manuals or codebases within the one million token window.
  • Automated Code Generation — Generate and refactor code using built-in reasoning and tool-use capabilities.
  • High Throughput Chat — Handle conversational workloads that require fast text generation and structured JSON outputs.
  • Reasoning Heavy Workflows — Execute multi-step logical tasks where active parameter routing improves accuracy.

Not ideal for

Tasks requiring image or video understanding, or workloads that need output sequences longer than 32,768 tokens.

Pick something else when

Example

Agent query example

Ask the API which models fit, instead of hardcoding an id:

FAQ

Does this model support image inputs? No, it is strictly text-only for both input and output modalities. How does prompt caching work with this model? Repeated prompt prefixes are billed at this model’s cached input rate, reducing costs for long-context or system-prompt-heavy workflows. Can I use function calling and structured outputs? Yes, the model natively supports tool use and structured JSON responses, which are routed through Kyma’s OpenAI-compatible API.