distilgpt2 vs SmolLM2-135M-Instruct

Specs, VRAM requirements and download trends — updated 6 August 2026.

distilbert · A
Params
90 M
Context
30d
2.6 M
apache-2.0 · commercial OK
HuggingFaceTB · B
Params
130 M
Context
8,192
30d
2.0 M
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification distilgpt2 SmolLM2-135M-Instruct
Parameters 90 M 130 M
Architecture GPT2LMHeadModel LlamaForCausalLM
Context length 8,192
Licence apache-2.0 apache-2.0
Commercial use Allowed Allowed
Languages 1 1
Downloads 30d 2,640,611 1,974,974
Downloads all time 252.9 M 13.0 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2022-03-02 2024-10-31

Download trend

Daily snapshots, last 10 days (28 Jul – 6 Aug)

2.7 M2.0 M
distilgpt2 SmolLM2-135M-Instruct

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

SmolLM2-135M-Instruct · fp16 0.8 GB / 24 GB
✅ Runs comfortably
distilgpt2 · fp16 0.9 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons