all-MiniLM-L6-v2 vs all-MiniLM-L6-v2-GGUF
Specs, VRAM requirements and download trends — updated 9 October 2026.
sentence-transformers · A · Open weights
Params
20 M
Context
512
30d
177.6 M
apache-2.0 · commercial OK
leliuga · B · Open weights
Params
20 M
Context
512
30d
396 K
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | all-MiniLM-L6-v2 | all-MiniLM-L6-v2-GGUF |
|---|---|---|
| Parameters | 20 M | 20 M |
| Architecture | BertModel | BertModel |
| Context length | 512 | 512 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 177,602,109 | 396,202 |
| Downloads all time | 4.2 B | 500 K |
| Quantizations on the Hub | SAFETENSORS | GGUF |
| Gated | No | No |
| First seen on the Hub | 2022-03-02 | 2024-03-15 |
Download trend
Daily snapshots, last 90 days (13 Aug – 10 Nov)
259.7 M396 K
all-MiniLM-L6-v2
all-MiniLM-L6-v2-GGUF
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
all-MiniLM-L6-v2-GGUF · Q4_0
0.5 GB / 24 GB
all-MiniLM-L6-v2 · fp16
0.6 GB / 24 GB