Kujira / text-generation Open weights updated 1 month ago

Underdog-Saluki-27B-1.0-MTP-Abliterated-GGUF

Underdog Saluki 27B 1.0 + MTP with refusals removed. It answers requests that the original model refuses, and otherwise behaves close to the original: same file size, same speed, MTP self-speculative decoding still works.

Params
27.0 B
Context
—
Downloads 30d
325 K
Likes
61
Commercial use: allowed apache-2.0 Not gated GGUF 2 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
325 K141 K
Nov 1Nov 4Nov 7Nov 10

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
Underdog-Saluki-27B-1.0-IQ2-mix-MTP-abliterated.gguf Q2 8.3 GB 13.7 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · ollama · Q2
$ ollama run underdog-saluki-27b-1-0-mtp-abliterated-gguf

# pin the quantization explicitly
$ ollama run underdog-saluki-27b-1-0-mtp-abliterated-gguf-q2
est. VRAM 13.7 GBon RTX 4090 · 24 GBJSON API →

Specifications

Parameters
27.0 B
Licence
apache-2.0
First seen on the Hub
2026-10-09
Training datasets
undisclosed
Added to our catalog
2026-11-01
Compare with any text-generation model