Qwen3-4B-Instruct-2507 vs PowerMoE-3b

Specs, VRAM requirements and download trends — updated 21 September 2026.

Qwen · A
Params
4.0 B
Context
262,144
30d
4.0 M
apache-2.0 · commercial OK
ibm-research · B
Params
3.4 B
Context
4,096
30d
1.2 M
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen3-4B-Instruct-2507 PowerMoE-3b
Parameters 4.0 B 3.4 B
Architecture Qwen3ForCausalLM GraniteMoeForCausalLM
Context length 262,144 4,096
Licence apache-2.0 apache-2.0
Commercial use Allowed Allowed
Languages
Downloads 30d 3,978,519 1,181,539
Downloads all time 61.8 M 11.9 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2025-08-05 2024-08-14

Download trend

Daily snapshots, last 56 days (28 Jul – 21 Sep)

4.0 M1.1 M
Qwen3-4B-Instruct-2507 PowerMoE-3b

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

PowerMoE-3b · fp16 15.9 GB / 24 GB
✅ Runs comfortably
Qwen3-4B-Instruct-2507 · fp16 @ 256K ctx 28.6 GB / 24 GB
❌ Won’t fit

Adjacent comparisons