gpt2 vs tiny-mixtral
Specs, VRAM requirements and download trends — updated 6 August 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | gpt2 | tiny-mixtral |
|---|---|---|
| Parameters | 140 M | 250 M |
| Architecture | GPT2LMHeadModel | MixtralForCausalLM |
| Context length | — | 131,072 |
| Licence | mit | — |
| Commercial use | Allowed | Unknown |
| Languages | 1 | — |
| Downloads 30d | 13,734,664 | 489,554 |
| Downloads all time | 901.9 M | 2.7 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2022-03-02 | 2024-04-24 |
Download trend
Daily snapshots, last 10 days (28 Jul – 6 Aug)
13.9 M470 K
gpt2
tiny-mixtral
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
gpt2 · fp16
1.1 GB / 24 GB
tiny-mixtral · fp16 @ 128K ctx
2.2 GB / 24 GB