gpt2 vs gpt-neo-125m
Specs, VRAM requirements and download trends — updated 21 September 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | gpt2 | gpt-neo-125m |
|---|---|---|
| Parameters | 140 M | 150 M |
| Architecture | GPT2LMHeadModel | GPTNeoForCausalLM |
| Context length | — | 2,048 |
| Licence | mit | mit |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 15,132,408 | 538,302 |
| Downloads all time | 926.2 M | 10.7 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2022-03-02 | 2022-03-02 |
Download trend
Daily snapshots, last 56 days (28 Jul – 21 Sep)
15.6 M326 K
gpt2
gpt-neo-125m
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
gpt2 · fp16
1.1 GB / 24 GB
gpt-neo-125m · fp16
1.1 GB / 24 GB