Qwen2.5-7B-Instruct-AWQ vs Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Specs, VRAM requirements and download trends — updated 21 September 2026.
hugging-quants · B
Params
8.0 B
Context
131,072
30d
245 K
llama3.1 licence · conditional
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Qwen2.5-7B-Instruct-AWQ | Meta-Llama-3.1-8B-Instruct-AWQ-INT4 |
|---|---|---|
| Parameters | 7.6 B | 8.0 B |
| Architecture | Qwen2ForCausalLM | LlamaForCausalLM |
| Context length | 32,768 | 131,072 |
| Licence | apache-2.0 | llama3.1 |
| Commercial use | Allowed | Conditional |
| Languages | 1 | 8 |
| Downloads 30d | 3,504,235 | 244,679 |
| Downloads all time | 22.9 M | 7.7 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | No | No |
| First seen on the Hub | 2024-09-17 | 2024-07-19 |
Download trend
Daily snapshots, last 56 days (28 Jul – 21 Sep)
4.7 M167 K
Qwen2.5-7B-Instruct-AWQ
Meta-Llama-3.1-8B-Instruct-AWQ-INT4
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
Qwen2.5-7B-Instruct-AWQ · fp16
7.8 GB / 24 GB
Meta-Llama-3.1-8B-Instruct-AWQ-INT4 · fp16 @ 128K ctx
26.1 GB / 24 GB