distilgpt2 vs SmolLM-135M-Instruct-FP32

Specs, VRAM requirements and download trends — updated 25 October 2026.

distilbert · A · Open weights
Params
90 M
Context
—
30d
1.7 M
apache-2.0 · commercial OK
modularai · B · Open weights
Params
135 M
Context
2,048
30d
143 K

Specification comparison

Differences are highlighted; identical values are muted.

Specification distilgpt2 SmolLM-135M-Instruct-FP32
Parameters 90 M 135 M
Architecture GPT2LMHeadModel LlamaForCausalLM
Context length — 2,048
Licence apache-2.0 —
Commercial use Allowed Unknown
Languages 1 —
Downloads 30d 1,691,697 143,038
Downloads all time 258.3 M 313 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2022-03-02 2025-07-31

Download trend

90 days of snapshots recorded — chart in 0 days.

258.3 M
distilgpt2 · all-time downloads
313 K
SmolLM-135M-Instruct-FP32 · all-time downloads

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

distilgpt2 · fp16 0.9 GB / 24 GB
✅ Runs comfortably
SmolLM-135M-Instruct-FP32 · fp16 1.1 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons