Qwen2.5-3B-Instruct vs granite-4.0-h-micro

Specs, VRAM requirements and download trends — updated 24 October 2026.

Qwen · A · Open weights
Params
3.1 B
Context
32,768
30d
3.8 M
ibm-granite · B · Open weights
Params
3.2 B
Context
131,072
30d
9 K
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen2.5-3B-Instruct granite-4.0-h-micro
Deployment Open weights Open weights · also via API
Parameters 3.1 B 3.2 B
Architecture Qwen2ForCausalLM GraniteMoeHybridForCausalLM
Context length 32,768 131,072
Licence other apache-2.0
Commercial use Unknown Allowed
Languages 1 —
Downloads 30d 3,795,251 9,011
Downloads all time 124.4 M 254 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2024-09-17 2025-09-16
API input price / 1M tokens not on OpenRouter $0.017
API output price / 1M tokens not on OpenRouter $0.11
Est. cost per 1M input + 1M output tokens not on OpenRouter $0.13
Cached input / 1M tokens not on OpenRouter —
AA Intelligence Index not on OpenRouter 5.1
AA Coding Index not on OpenRouter —
AA Agentic Index not on OpenRouter —
Max output tokens not on OpenRouter 117,900
API providers not on OpenRouter 1
Tool calling not on OpenRouter No
Reasoning mode not on OpenRouter No

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

granite-4.0-h-micro $0.13

Download trend

Daily snapshots, last 89 days (28 Jul – 24 Oct)

7.6 M9 K
Qwen2.5-3B-Instruct granite-4.0-h-micro

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Qwen2.5-3B-Instruct · fp16 7.8 GB / 24 GB
✅ Runs comfortably
granite-4.0-h-micro · fp16 @ 128K ctx 15.2 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons