granite-4.1-8b vs gemma-2-9b-it-AWQ-INT4

Specs, VRAM requirements and download trends — updated 6 August 2026.

ibm-granite · A
Params
8.8 B
Context
131,072
30d
4.2 M
apache-2.0 · commercial OK
hugging-quants · B
Params
9.2 B
Context
8,192
30d
504 K
gemma licence · conditional

Specification comparison

Differences are highlighted; identical values are muted.

Specification granite-4.1-8b gemma-2-9b-it-AWQ-INT4
Parameters 8.8 B 9.2 B
Architecture GraniteForCausalLM Gemma2ForCausalLM
Context length 131,072 8,192
Licence apache-2.0 gemma
Commercial use Allowed Conditional
Languages 1
Downloads 30d 4,208,265 504,472
Downloads all time 5.0 M 605 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2026-04-06 2024-10-15

Download trend

Daily snapshots, last 10 days (28 Jul – 6 Aug)

4.2 M311 K
granite-4.1-8b gemma-2-9b-it-AWQ-INT4

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

gemma-2-9b-it-AWQ-INT4 · fp16 8.7 GB / 24 GB
✅ Runs comfortably
granite-4.1-8b · fp16 @ 128K ctx 40.9 GB / 24 GB
❌ Won’t fit

Adjacent comparisons