gpt2 vs gpt-neo-125m

Specs, VRAM requirements and download trends — updated 6 August 2026.

openai-community · A
Params
140 M
Context
30d
13.7 M
mit · commercial OK
EleutherAI · B
Params
150 M
Context
2,048
30d
350 K
mit · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification gpt2 gpt-neo-125m
Parameters 140 M 150 M
Architecture GPT2LMHeadModel GPTNeoForCausalLM
Context length 2,048
Licence mit mit
Commercial use Allowed Allowed
Languages 1 1
Downloads 30d 13,734,664 350,047
Downloads all time 901.9 M 9.8 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2022-03-02 2022-03-02

Download trend

Daily snapshots, last 10 days (28 Jul – 6 Aug)

13.9 M326 K
gpt2 gpt-neo-125m

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

gpt2 · fp16 1.1 GB / 24 GB
✅ Runs comfortably
gpt-neo-125m · fp16 1.1 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons