Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Non-uniform GGUF quantizations of a 512-expert MoE, produced with GSQ and RCO, with a vision projector for multimodal use.
Params
180.0 B
Context
—
Downloads 30d
6.4 M
Likes
985
Download history
daily snapshots · 22 days6.4 M952 K
Oct 2Oct 9Oct 16Oct 23
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| mmproj-Qwen3.8-Flash-Next-BF16.gguf | GGUF | 0.9 GB | 28.5 GB | ❌ Won’t fit |
| Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00001-of-00002.gguf | Q2 | 37.6 GB | 68.9 GB | ❌ Won’t fit |
| Qwen3.8-Flash-Next-GSQ-RCO-IQ2_XS-00001-of-00002.gguf | IQ2_XS | 39.2 GB | 70.6 GB | ❌ Won’t fit |
| Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00001-of-00002.gguf | IQ3_XXS | 47.0 GB | 79.2 GB | ❌ Won’t fit |
| Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00001-of-00002.gguf | IQ3_S | 54.8 GB | 87.8 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Specifications
- Parameters
- 180.0 B
- Licence
- apache-2.0
- First seen on the Hub
- 2026-09-07
- Base model
- Qwen3.8-Flash-Next
- Training datasets
- undisclosed
- Added to our catalog
- 2026-10-02
Family
Base model and the most-downloaded derivatives in the catalog.
Compare with any image-text-to-text model
Popular comparisons
Appears in