distilgpt2 vs pythia-160m
Specs, VRAM requirements and download trends — updated 10 November 2026.
EleutherAI · B · Open weights
Params
210 M
Context
2,048
30d
3.5 M
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | distilgpt2 | pythia-160m |
|---|---|---|
| Parameters | 90 M | 210 M |
| Architecture | GPT2LMHeadModel | GPTNeoXForCausalLM |
| Context length | — | 2,048 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 1,481,788 | 3,495,753 |
| Downloads all time | 259.1 M | 32.2 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2022-03-02 | 2023-02-08 |
Download trend
Daily snapshots, last 90 days (13 Aug – 10 Nov)
3.5 M1.5 M
distilgpt2
pythia-160m
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
distilgpt2 · fp16
0.9 GB / 24 GB
pythia-160m · fp16
0.9 GB / 24 GB