Qwen2.5-7B-Instruct vs Qwen2.5-7B-Instruct-GGUF
Specs, VRAM requirements and download trends — updated 25 October 2026.
Qwen · A · Open weights
Params
7.6 B
Context
32,768
30d
6.1 M
apache-2.0 · commercial OK
Qwen · B · Open weights
Params
7.0 B
Context
32,768
30d
187 K
apache-2.0 · commercial OK
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Qwen2.5-7B-Instruct | Qwen2.5-7B-Instruct-GGUF |
|---|---|---|
| Deployment | Open weights · also via API | Open weights |
| Parameters | 7.6 B | 7.0 B |
| Architecture | Qwen2ForCausalLM | — |
| Context length | 32,768 | 32,768 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 6,077,597 | 187,040 |
| Downloads all time | 190.2 M | 1.3 M |
| Quantizations on the Hub | SAFETENSORS | GGUF |
| Gated | No | No |
| First seen on the Hub | 2024-09-16 | 2024-09-17 |
| API input price / 1M tokens | $0.10 | not on OpenRouter |
| API output price / 1M tokens | $0.20 | not on OpenRouter |
| Est. cost per 1M input + 1M output tokens | $0.30 | not on OpenRouter |
| Cached input / 1M tokens | — | not on OpenRouter |
| AA Intelligence Index | — | not on OpenRouter |
| AA Coding Index | — | not on OpenRouter |
| AA Agentic Index | — | not on OpenRouter |
| Max output tokens | 29,491 | not on OpenRouter |
| API providers | 1 | not on OpenRouter |
| Tool calling | Yes | not on OpenRouter |
| Reasoning mode | No | not on OpenRouter |
API cost
Estimated cost of 1M input + 1M output tokens via OpenRouter
Qwen2.5-7B-Instruct
$0.30
Download trend
Daily snapshots, last 90 days (28 Jul – 25 Oct)
12.3 M170 K
Qwen2.5-7B-Instruct
Qwen2.5-7B-Instruct-GGUF
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
Qwen2.5-7B-Instruct-GGUF · Q4_0
5.9 GB / 24 GB
Qwen2.5-7B-Instruct · fp16
18.4 GB / 24 GB