Qwen2.5-3B-Instruct vs Ternary-Bonsai-27B-mlx-2bit

Specs, VRAM requirements and download trends — updated 21 September 2026.

Qwen · A
Params
3.1 B
Context
32,768
30d
4.8 M
prism-ml · B
Params
2.6 B
Context
30d
1.1 M
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen2.5-3B-Instruct Ternary-Bonsai-27B-mlx-2bit
Parameters 3.1 B 2.6 B
Architecture Qwen2ForCausalLM Qwen3_5ForConditionalGeneration
Context length 32,768
Licence other apache-2.0
Commercial use Unknown Allowed
Languages 1
Downloads 30d 4,751,814 1,065,043
Downloads all time 120.0 M 2.9 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2024-09-17 2026-07-04

Download trend

Daily snapshots, last 56 days (28 Jul – 21 Sep)

7.6 M197 K
Qwen2.5-3B-Instruct Ternary-Bonsai-27B-mlx-2bit

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Qwen2.5-3B-Instruct · fp16 7.8 GB / 24 GB
✅ Runs comfortably
Ternary-Bonsai-27B-mlx-2bit · fp16 10.2 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons