Qwen3-4B vs PowerMoE-3b
Specs, VRAM requirements and download trends — updated 18 October 2026.
ibm-research · B · Open weights
Params
3.4 B
Context
4,096
30d
171 K
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Qwen3-4B | PowerMoE-3b |
|---|---|---|
| Parameters | 4.0 B | 3.4 B |
| Architecture | Qwen3ForCausalLM | GraniteMoeForCausalLM |
| Context length | 40,960 | 4,096 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | — | — |
| Downloads 30d | 4,013,632 | 170,877 |
| Downloads all time | 94.5 M | 12.0 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2025-04-27 | 2024-08-14 |
Download trend
Daily snapshots, last 90 days (13 Aug – 10 Nov)
12.6 M171 K
Qwen3-4B
PowerMoE-3b
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
Qwen3-4B · fp16
10.0 GB / 24 GB
PowerMoE-3b · fp16
15.9 GB / 24 GB