LiquidAI / text-generation updated 17 hours ago

LFM2.5-1.2B-Instruct-GGUF

LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.

Params
Context
Downloads 30d
252 K
Likes
205
Licence: other Not gated GGUF 8 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
317 K252 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
LFM2.5-1.2B-Instruct-Q4_0.gguf Q4_0 0.7 GB 1.3 GB ✅ Runs comfortably
LFM2.5-1.2B-Instruct-Q4_K_M.gguf Q4_K_M 0.7 GB 1.3 GB ✅ Runs comfortably
LFM2.5-1.2B-Instruct-Q5_K_M.gguf Q5_K_M 0.8 GB 1.4 GB ✅ Runs comfortably
LFM2.5-1.2B-Instruct-Q6_K.gguf Q6_K 1.0 GB 1.6 GB ✅ Runs comfortably
LFM2.5-1.2B-Instruct-Q8_0.gguf Q8_0 1.2 GB 1.9 GB ✅ Runs comfortably
LFM2.5-1.2B-Instruct-BF16.gguf GGUF 2.3 GB 3.1 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · ollama · Q4_0
$ ollama run lfm2-5-1-2b-instruct-gguf

# pin the quantization explicitly
$ ollama run lfm2-5-1-2b-instruct-gguf-q4_0
est. VRAM 1.3 GBon RTX 4090 · 24 GBJSON API →

Specifications

Licence
other
First seen on the Hub
2026-01-04
Base model
LFM2.5-1.2B-Instruct
Training datasets
undisclosed
Added to our catalog
2026-07-28

Family

Base model and the most-downloaded derivatives in the catalog.

Sponsored · GPU cloud
Not enough VRAM?
Spin up a 24 GB L4 instance in 40 seconds. $0.44/hr.