abenzerps / text-generation Open weights updated 4 weeks ago

Apodex-1.1-mini-GGUF

GGUF quantizations of apodex/Apodex-1.1-mini, a 35.95B-parameter Qwen3.5 MoE model for research, data, files, code, and tool-driven work.

Params
—
Context
—
Downloads 30d
439 K
Likes
20
Commercial use: allowed apache-2.0 Not gated GGUF 2 languages View on Hugging Face ↗

Download history

daily snapshots · 55 days
▲ 79 K in the last 30 days (15.3%)
544 K199 K
Sep 17Oct 5Oct 23Nov 10

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
Apodex-1.1-mini-IQ1_M.gguf IQ1_M 8.8 GB 10.2 GB ✅ Runs comfortably
Apodex-1.1-mini-IQ2_M.gguf IQ2_M 12.2 GB 14.0 GB ✅ Runs comfortably
Apodex-1.1-mini-Q2_K.gguf Q2_K 13.2 GB 15.1 GB ✅ Runs comfortably
Apodex-1.1-mini-IQ3_M.gguf IQ3_M 16.0 GB 18.1 GB ✅ Runs comfortably
Apodex-1.1-mini-Q3_K_M.gguf Q3_K_M 17.2 GB 19.4 GB ✅ Runs comfortably
Apodex-1.1-mini-Q4_Selective-Q4_K_M.gguf Q4_SELECTIVE 19.8 GB 22.2 GB ⚠️ Tight — reduce context
Apodex-1.1-mini-Q4_K_S.gguf Q4_K_S 20.4 GB 22.9 GB ⚠️ Tight — reduce context
Apodex-1.1-mini-Q4_K_M.gguf Q4_K_M 21.7 GB 24.4 GB ❌ Won’t fit
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · ollama · Q4_K_M
$ ollama run apodex-1-1-mini-gguf

# pin the quantization explicitly
$ ollama run apodex-1-1-mini-gguf-q4_k_m
est. VRAM 24.4 GBon RTX 4090 · 24 GBJSON API →

Specifications

Licence
apache-2.0
First seen on the Hub
2026-08-24
Training datasets
undisclosed
Added to our catalog
2026-09-17
Compare with any text-generation model