Ling-3.0-flash-GGUF
Ling 3.0 flash is a 124B MoE with 5.1B active parameters; its GGUF chat template includes thinking mode and tool calling. Our AD layouts have 31–41% lower mean KL than stock llama.cpp presets at comparable sizes. The raw measurements and controls are public. From the team behind Atomic Chat, the local AI app for chat and agents. These Ling files require our TurboQuant build; use the CLI instructions below. The tests...
Params
127.5 B
Context
262,144
Downloads 30d
247 K
Likes
67
Download history
daily snapshots · 75 days
▲ 887 in the last 30 days (0.4%)
248 K220 K
Oct 12Oct 22Nov 1Nov 10
351 K183 K
Aug 28Sep 22Oct 17Nov 10
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| Ling-3.0-flash-AD-IQ1_S.gguf | IQ1_S | 32.4 GB | 55.2 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ1_M.gguf | IQ1_M | 36.5 GB | 59.7 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ2_XXS.gguf | IQ2_XXS | 39.2 GB | 62.8 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ3_S-00001-of-00002.gguf | IQ3_S | 44.6 GB | 68.7 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ2_M-00001-of-00002.gguf | IQ2_M | 44.7 GB | 68.8 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ2_S-00001-of-00002.gguf | IQ2_S | 44.7 GB | 68.8 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ2_XS.gguf | IQ2_XS | 44.7 GB | 68.8 GB | ❌ Won’t fit |
| Ling-3.0-flash-AD-IQ3_M-00001-of-00002.gguf | IQ3_M | 45.0 GB | 69.1 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Run it
copy-paste, exact tags checked against the Hub$ ollama run ling-3-0-flash-gguf # pin the quantization explicitly $ ollama run ling-3-0-flash-gguf-iq1_m
$ huggingface-cli download AtomicChat/Ling-3.0-flash-GGUF-GGUF \
Ling-3.0-flash-AD-IQ1_M.gguf --local-dir .
$ llama-cli -m Ling-3.0-flash-AD-IQ1_M.gguf \
-c 8192 -ngl 99 -t 8 --color
$ curl -s https://aimodelscomparison.com/api/v1/models/ling-3-0-flash-gguf
{
"hf_id": "AtomicChat/Ling-3.0-flash-GGUF",
"params_b": 127.49,
"context_length": 262144,
"license": { "id": "mit", "commercial": "yes" },
"downloads_30d": 247103,
"vram_estimates": [
{ "quant": "IQ1_M", "gb": 59.7 },
{ "quant": "IQ1_S", "gb": 55.2 }
],
"updated_at": "2026-10-29T01:00:14Z"
}
Specifications
- Parameters
- 127.5 B
- Context length
- 262,144
- Licence
- mit
- First seen on the Hub
- 2026-08-04
- Base model
- Ling-3.0-flash
- Training datasets
- undisclosed
- Added to our catalog
- 2026-08-28
Family
Base model and the most-downloaded derivatives in the catalog.
Compare with any text-generation model