Qwen3-32B vs NVIDIA-Nemotron-3-Super-120B-A12B-FP8

Specs, VRAM requirements and download trends — updated 6 August 2026.

Qwen · A
Params
32.8 B
Context
40,960
30d
8.3 M
apache-2.0 · commercial OK
nvidia · B
Params
123.6 B
Context
262,144
30d
208 K

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen3-32B NVIDIA-Nemotron-3-Super-120B-A12B-FP8
Parameters 32.8 B 123.6 B
Architecture Qwen3ForCausalLM NemotronHForCausalLM
Context length 40,960 262,144
Licence apache-2.0 other
Commercial use Allowed Unknown
Languages 7
Downloads 30d 8,346,113 208,471
Downloads all time 49.9 M 2.4 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2025-04-27 2026-03-10

Download trend

Daily snapshots, last 10 days (28 Jul – 6 Aug)

10.1 M208 K
Qwen3-32B NVIDIA-Nemotron-3-Super-120B-A12B-FP8

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Qwen3-32B · fp16 77.5 GB / 24 GB
❌ Won’t fit
NVIDIA-Nemotron-3-Super-120B-A12B-FP8 · fp16 @ 256K ctx 735.0 GB / 24 GB
❌ Won’t fit

Adjacent comparisons