lmstudio-community / image-text-to-text updated 3 weeks ago

Qwen3.8-27B-MLX-5bit

👾 LM Studio Community models highlights program. Highlighting new & noteworthy models by the community. Join the conversation on Discord.

Params
5.5 B
Context
Downloads 30d
3.6 M
Likes
0
Commercial use: allowed apache-2.0 Not gated SAFETENSORS View on Hugging Face ↗

Download history

daily snapshots · 18 days
3.6 M943 K
Aug 23Aug 29Sep 4Sep 9

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors u32 19.4 GB 22.7 GB ⚠️ Tight — reduce context
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
Qwen3_5ForConditionalGeneration
Parameters
5.5 B
Tensor type
U32
Licence
apache-2.0
First seen on the Hub
2026-08-14
Base model
Qwen3.8-27B
Training datasets
undisclosed
Added to our catalog
2026-08-23

Family

Base model and the most-downloaded derivatives in the catalog.