Qwen2.5-7B-Instruct-AWQ vs mistral-7b-v0.3-bnb-4bit
Specs, VRAM requirements and download trends — updated 6 August 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Qwen2.5-7B-Instruct-AWQ | mistral-7b-v0.3-bnb-4bit |
|---|---|---|
| Parameters | 7.6 B | 7.5 B |
| Architecture | Qwen2ForCausalLM | MistralForCausalLM |
| Context length | 32,768 | 32,768 |
| Licence | apache-2.0 | apache-2.0 |
| Commercial use | Allowed | Allowed |
| Languages | 1 | 1 |
| Downloads 30d | 4,626,313 | 380,476 |
| Downloads all time | 16.8 M | 5.7 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2024-09-17 | 2024-05-22 |
Download trend
Daily snapshots, last 10 days (28 Jul – 6 Aug)
4.6 M372 K
Qwen2.5-7B-Instruct-AWQ
mistral-7b-v0.3-bnb-4bit
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
mistral-7b-v0.3-bnb-4bit · fp16
6.2 GB / 24 GB
Qwen2.5-7B-Instruct-AWQ · fp16
7.8 GB / 24 GB