Qwen2.5-3B-Instruct vs Ternary-Bonsai-27B-mlx-2bit
Specs, VRAM requirements and download trends — updated 6 August 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Qwen2.5-3B-Instruct | Ternary-Bonsai-27B-mlx-2bit |
|---|---|---|
| Parameters | 3.1 B | 2.6 B |
| Architecture | Qwen2ForCausalLM | Qwen3_5ForConditionalGeneration |
| Context length | 32,768 | — |
| Licence | other | apache-2.0 |
| Commercial use | Unknown | Allowed |
| Languages | 1 | — |
| Downloads 30d | 5,952,246 | 452,728 |
| Downloads all time | 110.0 M | 453 K |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2024-09-17 | 2026-07-04 |
Download trend
Daily snapshots, last 10 days (28 Jul – 6 Aug)
6.0 M197 K
Qwen2.5-3B-Instruct
Ternary-Bonsai-27B-mlx-2bit
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
Qwen2.5-3B-Instruct · fp16
7.8 GB / 24 GB
Ternary-Bonsai-27B-mlx-2bit · fp16
10.2 GB / 24 GB