audio.cpp-gguf
This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with audio.cpp.
Params
—
Context
—
Downloads 30d
8.9 M
Likes
309
Download history
daily snapshots · 85 days
▲ 2.5 M in the last 30 days (39.3%)
8.9 M6.2 M
Oct 12Oct 22Nov 1Nov 10
8.9 M419 K
Aug 18Sep 15Oct 13Nov 10
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| model.safetensors | fp16 | 1.0 GB | 1.6 GB | ✅ Runs comfortably |
| phonon-2-mixed-q8.gguf | Q8 | 1.2 GB | 1.8 GB | ✅ Runs comfortably |
| kitten-tts2-20261021-tq2_1.gguf | Q2_1 | 2.2 GB | 2.9 GB | ✅ Runs comfortably |
| qwen3-tts-12hz-1.7b-base-q8_0_v2.gguf | Q8_0_V2 | 2.7 GB | 3.5 GB | ✅ Runs comfortably |
| breeze-tts-2-q4_0.gguf | Q4_0 | 3.8 GB | 4.7 GB | ✅ Runs comfortably |
| personaplex-7b-v1-q4_k.gguf | Q4_K | 7.9 GB | 9.1 GB | ✅ Runs comfortably |
| dit_int8.gguf | Q4 | 17.4 GB | 19.7 GB | ⚠️ Tight — reduce context |
| dramabox-q8_0.gguf | Q8_0 | 18.9 GB | 21.3 GB | ⚠️ Tight — reduce context |
| firered-audio-orig.gguf | GGUF | 25.0 GB | 28.0 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Specifications
- Licence
- other
- First seen on the Hub
- 2026-07-14
- Training datasets
- undisclosed
- Added to our catalog
- 2026-08-18
Compare with any text-to-speech model
Popular comparisons
Appears in