ggml-org / image-text-to-text updated 21 hours ago

Qwen3.8-27B-GGUF

Name: Qwen3.8-27B-GGUF
Author: ggml-org

> [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert

Params

27.0 B

Context

—

Downloads 30d

1.2 M

Likes

Commercial use: allowed apache-2.0 Not gated GGUF View on Hugging Face ↗

Download history

daily snapshots · 21 days

1.5 M909 K

Sep 1Sep 8Sep 15Sep 21

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
mtp-Qwen3.8-27B-Q4_0.gguf	Q4_0	1.7 GB	6.4 GB	✅ Runs comfortably
Qwen3.8-27B-Q4_K_M.gguf	Q4_K_M	19.0 GB	25.4 GB	❌ Won’t fit
Qwen3.8-27B-Q8_0.gguf	Q8_0	28.6 GB	36.0 GB	❌ Won’t fit
Qwen3.8-27B-BF16.gguf	GGUF	53.8 GB	63.7 GB	❌ Won’t fit

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Base model and the most-downloaded derivatives in the catalog.

Compare with any image-text-to-text model

Popular comparisons