unsloth / image-text-to-text updated 4 months ago

Qwen3.6-27B-GGUF

Name: Qwen3.6-27B-GGUF
Author: unsloth

See Unsloth Dynamic 2.0 GGUFs for our quantization benchmarks. Developer Role Support so Qwen3.6 can work in Codex, OpenCode and more! Qwen3.6 can now be run and fine-tuned in Unsloth Studio. Read our guide. Tool calling improvements: Makes parsing nested objects to make tool calling succeed more. Example of Qwen3.6 35B-A3B (4-bit GGUF) running in Unsloth Studio with tool-calling:

Params

—

Context

—

Downloads 30d

1.1 M

Likes

957

Commercial use: allowed apache-2.0 Not gated GGUF View on Hugging Face ↗

Download history

daily snapshots · 37 days

▲ 156 K in the last 30 days (16.5%)

1.3 M811 K

Aug 16Aug 28Sep 9Sep 21

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
Qwen3.6-27B-Q3_K_S.gguf	Q3_K_S	12.4 GB	14.1 GB	✅ Runs comfortably
Qwen3.6-27B-Q3_K_M.gguf	Q3_K_M	13.6 GB	15.4 GB	✅ Runs comfortably
Qwen3.6-27B-IQ4_XS.gguf	IQ4_XS	15.4 GB	17.5 GB	✅ Runs comfortably
Qwen3.6-27B-Q4_0.gguf	Q4_0	15.8 GB	17.9 GB	✅ Runs comfortably
Qwen3.6-27B-IQ4_NL.gguf	IQ4_NL	16.1 GB	18.2 GB	✅ Runs comfortably
Qwen3.6-27B-Q4_K_M.gguf	Q4_K_M	16.8 GB	19.0 GB	✅ Runs comfortably
Qwen3.6-27B-Q4_1.gguf	Q4_1	17.3 GB	19.5 GB	✅ Runs comfortably
Qwen3.6-27B-BF16-00001-of-00002.gguf	GGUF	50.0 GB	55.5 GB	❌ Won’t fit

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Licence: apache-2.0
First seen on the Hub: 2026-04-22
Base model: Qwen3.6-27B
Training datasets: undisclosed
Added to our catalog: 2026-08-16

Family

Base model and the most-downloaded derivatives in the catalog.

Base Qwen3.6-27B Qwen 3.5 M

Compare with any image-text-to-text model

Popular comparisons

Qwen3-VL-8B-Instruct 19.7 M gemma-4-26B-A4B-it 10.0 M Qwen3.6-35B-A3B-FP8 9.5 M Qwen3.5-9B 9.2 M gemma-4-31B-it 9.0 M Qwen3.8-27B 7.3 M