handy-computer / automatic-speech-recognition updated 1 month ago

parakeet-unified-en-0.6b-gguf

Name: parakeet-unified-en-0.6b-gguf
Author: handy-computer

GGUF conversions of nvidia/parakeet-unified-en-0.6b for use with transcribe.cpp.

Params

—

Context

—

Downloads 30d

1.9 M

Likes

Commercial use: allowed cc-by-4.0 Not gated GGUF 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

1.9 M1.6 M

Jul 28Jul 31Aug 3Aug 6

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
parakeet-unified-en-0.6b-Q4_K_M.gguf	Q4_K_M	0.5 GB	1.0 GB	✅ Runs comfortably
parakeet-unified-en-0.6b-Q5_K_M.gguf	Q5_K_M	0.5 GB	1.1 GB	✅ Runs comfortably
parakeet-unified-en-0.6b-Q6_K.gguf	Q6_K	0.6 GB	1.2 GB	✅ Runs comfortably
parakeet-unified-en-0.6b-Q8_0.gguf	Q8_0	0.7 GB	1.3 GB	✅ Runs comfortably
parakeet-unified-en-0.6b-F32.gguf	GGUF	2.5 GB	3.2 GB	✅ Runs comfortably

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Compare with

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB