opt-125m vs pythia-70m-deduped
Specs, VRAM requirements and download trends — updated 10 November 2026.
EleutherAI · B · Open weights
Params
100 M
Context
2,048
30d
729 K
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | opt-125m | pythia-70m-deduped |
|---|---|---|
| Parameters | 125 M | 100 M |
| Architecture | OPTForCausalLM | GPTNeoXForCausalLM |
| Context length | 2,048 | 2,048 |
| Licence | other | apache-2.0 |
| Commercial use | Unknown | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 4,677,401 | 728,542 |
| Downloads all time | 222.9 M | 17.3 M |
| Quantizations on the Hub | — | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2022-05-11 | 2023-02-13 |
Download trend
Daily snapshots, last 90 days (13 Aug – 10 Nov)
17.5 M729 K
opt-125m
pythia-70m-deduped
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
pythia-70m-deduped · fp16
0.7 GB / 24 GB