Abiray / text-generation Open weights updated 1 week ago

DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-IQ2_XXS-GGUF

This repository provides a standalone, weight-baked abliterated (uncensored) GGUF build of ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF (IQ2XXS).

Params
763.2 B
Context
—
Downloads 30d
490 K
Likes
105
Commercial use: allowed mit Not gated GGUF View on Hugging Face ↗

Download history

daily snapshots · 12 days
490 K172 K
Oct 30Nov 3Nov 7Nov 10

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
mmproj-DeepSeek-V4.1-Flash-1017-BF16.gguf GGUF 1.0 GB 116.1 GB ❌ Won’t fit
DeepSeek-V4.1-Flash-1017-GSQ-RCO-IQ2_XXS-00003-of-00006.gguf IQ2_XXS 39.9 GB 158.8 GB ❌ Won’t fit
DeepSeek-V4.1-Flash-Engram-IQ4_NL.gguf IQ4_NL 110.6 GB 236.6 GB ❌ Won’t fit
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · ollama · IQ2_XXS
$ ollama run deepseek-v4-1-flash-1017-uncensored-gsq-rco-iq2-xxs-gguf

# pin the quantization explicitly
$ ollama run deepseek-v4-1-flash-1017-uncensored-gsq-rco-iq2-xxs-gguf-iq2_xxs
est. VRAM 158.8 GBon RTX 4090 · 24 GBJSON API →

Specifications

Parameters
763.2 B
Licence
mit
First seen on the Hub
2026-10-24
Base model
DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
Training datasets
undisclosed
Added to our catalog
2026-10-30

Family

Base model and the most-downloaded derivatives in the catalog.

Compare with any text-generation model