NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
:---:--- Total Parameters 550B (55B active) Architecture LatentMoE - Mamba-2 + MoE + Attention hybrid with Multi-Token Prediction (MTP) Context Length Up to 1M tokens Minimum GPU Requirement 4xGB200, 4xB200, 4x GB300, 4x B300, 8xH100 Supported Languages English, French, Spanish, Italian, German, Japanese, Hindi, Korean, Brazilian Portuguese, and Chinese Best For Frontier reasoning, complex agentic workflows, long-con...
Params
335.0 B
Context
262,144
Downloads 30d
233 K
Likes
279
Download history
daily snapshots · 10 days257 K233 K
Jul 28Jul 31Aug 3Aug 6
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| model.safetensors | u8 | 352.3 GB | 438.3 GB | ❌ Won’t fit |
| model.safetensors (bf16, full) | bf16 + 256K ctx | 352.3 GB | 1,996.2 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Run it
copy-paste, exact tags checked against the Hub$ curl -s https://aimodelscomparison.com/api/v1/models/nvidia-nemotron-3-ultra-550b-a55b-nvfp4
{
"hf_id": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
"params_b": 335.04,
"context_length": 262144,
"license": { "id": "other", "commercial": "unknown" },
"downloads_30d": 233194,
"vram_estimates": [
{ "quant": "u8", "gb": 438.3 }
],
"updated_at": "2026-07-28T18:07:11Z"
}
Specifications
- Architecture
- NemotronHForCausalLM
- Parameters
- 335.0 B
- Tensor type
- U8
- Context length
- 262,144
- Vocabulary
- 131,072
- Licence
- other
- First seen on the Hub
- 2026-06-03
- Training datasets
- nvidia/nemotron-post-training-v3, nvidia/nemotron-pre-training-datasets
- Added to our catalog
- 2026-07-28
Compare with
Sponsored · GPU cloud
Not enough VRAM?
Spin up a 24 GB L4 instance in 40 seconds. $0.44/hr.