Qwen2.5-72B-Instruct-AWQ vs Llama-3.1-70B-Instruct

Specs, VRAM requirements and download trends — updated 21 August 2026.

Qwen · A · Open weights
Params
73.0 B
Context
32,768
30d
453 K
meta-llama · B · Open weights
Params
70.6 B
Context
—
30d
203 K
llama3.1 licence · conditional

Specification comparison

Differences are highlighted; identical values are muted.

Specification Qwen2.5-72B-Instruct-AWQ Llama-3.1-70B-Instruct
Deployment Open weights Open weights · also via API
Parameters 73.0 B 70.6 B
Architecture Qwen2ForCausalLM LlamaForCausalLM
Context length 32,768 131,072
Licence other llama3.1
Commercial use Unknown Conditional
Languages 1 8
Downloads 30d 452,522 203,439
Downloads all time 12.4 M 24.5 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated No Yes — accept licence
First seen on the Hub 2024-09-17 2024-07-16
API input price / 1M tokens not on OpenRouter $0.40
API output price / 1M tokens not on OpenRouter $0.40
Est. cost per 1M input + 1M output tokens not on OpenRouter $0.80
Cached input / 1M tokens not on OpenRouter —
AA Intelligence Index not on OpenRouter 6.6
AA Coding Index not on OpenRouter —
AA Agentic Index not on OpenRouter —
Max output tokens not on OpenRouter 16,384
API providers not on OpenRouter 2
Tool calling not on OpenRouter Yes
Reasoning mode not on OpenRouter No

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

Llama-3.1-70B-Instruct $0.80

Download trend

Daily snapshots, last 89 days (28 Jul – 24 Oct)

1.3 M203 K
Qwen2.5-72B-Instruct-AWQ Llama-3.1-70B-Instruct A overtook B on 5 Sep

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Qwen2.5-72B-Instruct-AWQ · fp16 57.2 GB / 24 GB
❌ Won’t fit
Llama-3.1-70B-Instruct · fp16 166.3 GB / 24 GB
❌ Won’t fit

Adjacent comparisons