yuxinlu1 / text-generation updated 1 month ago

gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

--- license: apache-2.0 basemodel: google/gemma-4-12B-it libraryname: gguf pipelinetag: text-generation tags: [gemma4, coding, code, reasoning, thinking, gguf, llama.cpp, local-llm] ---

Params
Context
Downloads 30d
298 K
Likes
2,805
Commercial use: allowed apache-2.0 Not gated GGUF View on Hugging Face ↗

Download history

daily snapshots · 10 days
299 K233 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
gemma4-coding-Q2_K.gguf Q2_K 4.8 GB 5.8 GB ✅ Runs comfortably
gemma4-coding-Q3_K_M.gguf Q3_K_M 6.1 GB 7.2 GB ✅ Runs comfortably
gemma4-coding-Q4_K_M.gguf Q4_K_M 7.4 GB 8.6 GB ✅ Runs comfortably
gemma4-coding-Q6_K.gguf Q6_K 9.8 GB 11.3 GB ✅ Runs comfortably
gemma4-coding-Q8_0.gguf Q8_0 12.7 GB 14.4 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · ollama · Q4_K_M
$ ollama run gemma-4-12b-coder-fable5-composer2-5-v1-gguf

# pin the quantization explicitly
$ ollama run gemma-4-12b-coder-fable5-composer2-5-v1-gguf-q4_k_m
est. VRAM 8.6 GBon RTX 4090 · 24 GBJSON API →

Specifications

Licence
apache-2.0
First seen on the Hub
2026-06-10
Training datasets
undisclosed
Added to our catalog
2026-07-28
Sponsored · GPU cloud
Not enough VRAM?
Spin up a 24 GB L4 instance in 40 seconds. $0.44/hr.