Qwen3-8B vs Mellum2.1-12B-A2.5B-Thinking-GGUF

Specs, VRAM requirements and download trends — updated 25 October 2026.

Qwen · A · Open weights
Params
8.2 B
Context
40,960
30d
8.2 M
apache-2.0 · commercial OK
JetBrains · B · Open weights
Params
12.0 B
Context
—
30d
215 K
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen3-8B Mellum2.1-12B-A2.5B-Thinking-GGUF
Parameters 8.2 B 12.0 B
Architecture Qwen3ForCausalLM —
Context length 40,960 —
Licence apache-2.0 apache-2.0
Commercial use Allowed Allowed
Languages — 1
Downloads 30d 8,164,793 214,663
Downloads all time 133.8 M 215 K
Quantizations on the Hub SAFETENSORS GGUF
Gated No No
First seen on the Hub 2025-04-27 2026-10-07

Download trend

Daily snapshots, last 90 days (28 Jul – 25 Oct)

16.6 M152 K
Qwen3-8B Mellum2.1-12B-A2.5B-Thinking-GGUF

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Mellum2.1-12B-A2.5B-Thinking-GGUF · Q4_K_M 11.5 GB / 24 GB
✅ Runs comfortably
Qwen3-8B · fp16 19.7 GB / 24 GB
⚠️ Tight — reduce context

Adjacent comparisons