Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
This is an uncensored version of Qwen/Qwen3.6-35B-A3B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
Params
35.0 B
Context
—
Downloads 30d
4.9 M
Likes
83
Download history
daily snapshots · 15 days4.9 M980 K
Oct 27Nov 1Nov 6Nov 10
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q2_K.gguf | Q2_K | 13.2 GB | 20.3 GB | ⚠️ Tight — reduce context |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q3_K.gguf | Q3_K | 17.2 GB | 24.6 GB | ❌ Won’t fit |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q4_K.gguf | Q4_K | 21.7 GB | 29.6 GB | ❌ Won’t fit |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q5_K.gguf | Q5_K | 25.3 GB | 33.6 GB | ❌ Won’t fit |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q6_K.gguf | Q6_K | 29.2 GB | 37.9 GB | ❌ Won’t fit |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-Q8_0.gguf | Q8_0 | 37.8 GB | 47.3 GB | ❌ Won’t fit |
| Huihui-Qwen3.6-35B-A3B-abliterated-ggml-model-f16.gguf | GGUF | 71.1 GB | 83.9 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Specifications
- Parameters
- 35.0 B
- Licence
- apache-2.0
- First seen on the Hub
- 2026-05-19
- Base model
- Qwen3.6-35B-A3B
- Training datasets
- undisclosed
- Added to our catalog
- 2026-10-27
Family
Base model and the most-downloaded derivatives in the catalog.
Compare with any image-text-to-text model
Popular comparisons
Appears in