AImodelsComparison.com 1,011 models
Menu
Models Best of Trending Can I run it? Methodology About
empero-ai / image-text-to-text updated 3 weeks ago

Qwythos-9B-Claude-Mythos-5-1M-GGUF

GGUF quantizations of empero-ai/Qwythos-9B-Claude-Mythos-5-1M for llama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.

Params
—
Context
—
Downloads 30d
922 K
Likes
2,530
Commercial use: allowed apache-2.0 Not gated GGUF 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
1.3 M922 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
Qwythos-9B-Claude-Mythos-5-1M-MTP-Q4_K_M.gguf Q4_K_M 5.9 GB 7.0 GB ✅ Runs comfortably
Qwythos-9B-Claude-Mythos-5-1M-MTP-Q5_K_M.gguf Q5_K_M 6.7 GB 7.9 GB ✅ Runs comfortably
Qwythos-9B-Claude-Mythos-5-1M-MTP-Q6_K.gguf Q6_K 7.6 GB 8.9 GB ✅ Runs comfortably
Qwythos-9B-Claude-Mythos-5-1M-MTP-Q8_0.gguf Q8_0 9.8 GB 11.3 GB ✅ Runs comfortably
Qwythos-9B-Claude-Mythos-5-1M-MTP-BF16.gguf GGUF 18.4 GB 20.7 GB ⚠️ Tight — reduce context
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Licence
apache-2.0
First seen on the Hub
2026-06-19
Training datasets
undisclosed
Added to our catalog
2026-07-28
Compare with
Qwen3.5-9B 12.4 M gemma-4-31B-it 11.9 M gemma-4-26B-A4B-it 11.7 M Qwen2.5-VL-7B-Instruct 9.3 M Qwen3.6-35B-A3B-FP8 8.9 M Qwen2.5-VL-3B-Instruct 8.2 M
Appears in
Best open coding models Commercial-use text models Models that fit in 12 GB
Sponsored · GPU cloud
Not enough VRAM?
Spin up a 24 GB L4 instance in 40 seconds. $0.44/hr.