pythia-14m vs gpt2-mini
Specs, VRAM requirements and download trends — updated 10 November 2026.
EleutherAI · A · Open weights
Params
10 M
Context
2,048
30d
299 K
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | pythia-14m | gpt2-mini |
|---|---|---|
| Parameters | 10 M | 39 M |
| Architecture | GPTNeoXForCausalLM | GPT2LMHeadModel |
| Context length | 2,048 | — |
| Licence | apache-2.0 | mit |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 299,420 | 285,168 |
| Downloads all time | 2.4 M | 1.9 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2026-02-24 | 2024-06-23 |
Download trend
Daily snapshots, last 90 days (13 Aug – 10 Nov)
699 K137 K
pythia-14m
gpt2-mini
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
pythia-14m · fp16
0.5 GB / 24 GB
gpt2-mini · fp16
0.7 GB / 24 GB