facebook / text-generation Open weights updated 3 years ago

opt-125m

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI.

Params
125 M
Context
2,048
Downloads 30d
4.7 M
Likes
333
Licence: other Not gated 1 languages View on Hugging Face ↗

Download history

daily snapshots · 106 days
▲ 1.4 M in the last 30 days (22.5%)
18.6 M4.4 M
Jul 28Sep 1Oct 6Nov 10

Run it

copy-paste, exact tags checked against the Hub
~ · curl · api/v1
$ curl -s https://aimodelscomparison.com/api/v1/models/opt-125m
{
  "hf_id": "facebook/opt-125m",
  "params_b": 0.13,
  "context_length": 2048,
  "license": { "id": "other", "commercial": "unknown" },
  "downloads_30d": 4677401,
  "vram_estimates": [

  ],
  "updated_at": "2026-09-18T01:00:03Z"
}
est. VRAM —on RTX 4090 · 24 GBJSON API →

Specifications

Architecture
OPTForCausalLM
Parameters
125 M
Context length
2,048
Vocabulary
50,272
Layers / heads
12 / 12
Licence
other
First seen on the Hub
2022-05-11
Training datasets
undisclosed
Added to our catalog
2026-07-28
Compare with any text-generation model