Qwen2.5-3B-Instruct vs zeta-2.1-autoround-W4A16

Specs, VRAM requirements and download trends — updated 20 September 2026.

Qwen · A
Params
3.1 B
Context
32,768
30d
5.1 M
LeaderboardModel1 · B
Params
2.2 B
Context
32,768
30d
427 K

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen2.5-3B-Instruct zeta-2.1-autoround-W4A16
Parameters 3.1 B 2.2 B
Architecture Qwen2ForCausalLM LlamaForCausalLM
Context length 32,768 32,768
Licence other
Commercial use Unknown Unknown
Languages 1
Downloads 30d 5,090,920 427,115
Downloads all time 119.8 M 429 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No No
First seen on the Hub 2024-09-17 2026-05-21

Download trend

Daily snapshots, last 55 days (28 Jul – 20 Sep)

7.6 M197 K
Qwen2.5-3B-Instruct zeta-2.1-autoround-W4A16

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

zeta-2.1-autoround-W4A16 · fp16 7.6 GB / 24 GB
✅ Runs comfortably
Qwen2.5-3B-Instruct · fp16 7.8 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons