opt-125m vs distilgpt2

Specs, VRAM requirements and download trends — updated 10 November 2026.

facebook · A · Open weights
Params
125 M
Context
2,048
30d
4.7 M
distilbert · B · Open weights
Params
90 M
Context
—
30d
1.5 M
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification opt-125m distilgpt2
Parameters 125 M 90 M
Architecture OPTForCausalLM GPT2LMHeadModel
Context length 2,048 —
Licence other apache-2.0
Commercial use Unknown Allowed
Languages 1 1
Downloads 30d 4,677,401 1,481,788
Downloads all time 222.9 M 259.1 M
Quantizations on the Hub — SAFETENSORS
Gated No No
First seen on the Hub 2022-05-11 2022-03-02

Download trend

Daily snapshots, last 90 days (13 Aug – 10 Nov)

17.5 M1.5 M
opt-125m distilgpt2

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

distilgpt2 · fp16 0.9 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons