Qwen3-8B vs PowerMoE-3b

Specs, VRAM requirements and download trends — updated 21 September 2026.

Qwen · A
Params
8.2 B
Context
40,960
30d
12.9 M
apache-2.0 · commercial OK
ibm-research · B
Params
3.4 B
Context
4,096
30d
1.2 M
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen3-8B PowerMoE-3b
Parameters 8.2 B 3.4 B
Architecture Qwen3ForCausalLM GraniteMoeForCausalLM
Context length 40,960 4,096
Licence apache-2.0 apache-2.0
Commercial use Allowed Allowed
Languages
Downloads 30d 12,880,320 1,181,539
Downloads all time 124.0 M 11.9 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2025-04-27 2024-08-14

Download trend

Daily snapshots, last 56 days (28 Jul – 21 Sep)

16.6 M1.1 M
Qwen3-8B PowerMoE-3b

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

PowerMoE-3b · fp16 15.9 GB / 24 GB
✅ Runs comfortably
Qwen3-8B · fp16 19.7 GB / 24 GB
⚠️ Tight — reduce context

Adjacent comparisons