distilgpt2 vs SmolLM2-135M
Specs, VRAM requirements and download trends — updated 21 September 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | distilgpt2 | SmolLM2-135M |
|---|---|---|
| Parameters | 90 M | 130 M |
| Architecture | GPT2LMHeadModel | LlamaForCausalLM |
| Context length | — | 8,192 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 2,070,768 | 1,977,502 |
| Downloads all time | 256.2 M | 20.6 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2022-03-02 | 2024-10-31 |
Download trend
Daily snapshots, last 56 days (28 Jul – 21 Sep)
2.7 M1.7 M
distilgpt2
SmolLM2-135M
A overtook B on 21 Sep
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
SmolLM2-135M · fp16
0.8 GB / 24 GB
distilgpt2 · fp16
0.9 GB / 24 GB