Qwen3-8B vs Ternary-Bonsai-27B-mlx-2bit

Specs, VRAM requirements and download trends — updated 6 August 2026.

Qwen · A
Params
8.2 B
Context
40,960
30d
16.3 M
apache-2.0 · commercial OK
prism-ml · B
Params
2.6 B
Context
30d
453 K
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen3-8B Ternary-Bonsai-27B-mlx-2bit
Parameters 8.2 B 2.6 B
Architecture Qwen3ForCausalLM Qwen3_5ForConditionalGeneration
Context length 40,960
Licence apache-2.0 apache-2.0
Commercial use Allowed Allowed
Languages
Downloads 30d 16,272,885 452,728
Downloads all time 103.2 M 453 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2025-04-27 2026-07-04

Download trend

Daily snapshots, last 10 days (28 Jul – 6 Aug)

16.6 M197 K
Qwen3-8B Ternary-Bonsai-27B-mlx-2bit

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Ternary-Bonsai-27B-mlx-2bit · fp16 10.2 GB / 24 GB
✅ Runs comfortably
Qwen3-8B · fp16 19.7 GB / 24 GB
⚠️ Tight — reduce context

Adjacent comparisons