Llama-3.1-70B-Instruct vs Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Specs, VRAM requirements and download trends — updated 30 July 2026.
meta-llama · A · Open weights
Params
70.6 B
Context
—
30d
203 K
llama3.1 licence · conditional
hugging-quants · B · Open weights
Params
70.6 B
Context
131,072
30d
140 K
llama3.1 licence · conditional
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Llama-3.1-70B-Instruct | Meta-Llama-3.1-70B-Instruct-AWQ-INT4 |
|---|---|---|
| Deployment | Open weights · also via API | Open weights |
| Parameters | 70.6 B | 70.6 B |
| Architecture | LlamaForCausalLM | LlamaForCausalLM |
| Context length | 131,072 | 131,072 |
| Licence | llama3.1 | llama3.1 |
| Commercial use | Conditional | Conditional |
| Languages | 8 | 8 |
| Downloads 30d | 203,439 | 140,116 |
| Downloads all time | 24.5 M | 5.4 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | Yes — accept licence | No |
| First seen on the Hub | 2024-07-16 | 2024-07-19 |
| API input price / 1M tokens | $0.40 | not on OpenRouter |
| API output price / 1M tokens | $0.40 | not on OpenRouter |
| Est. cost per 1M input + 1M output tokens | $0.80 | not on OpenRouter |
| Cached input / 1M tokens | — | not on OpenRouter |
| AA Intelligence Index | 6.6 | not on OpenRouter |
| AA Coding Index | — | not on OpenRouter |
| AA Agentic Index | — | not on OpenRouter |
| Max output tokens | 16,384 | not on OpenRouter |
| API providers | 2 | not on OpenRouter |
| Tool calling | Yes | not on OpenRouter |
| Reasoning mode | No | not on OpenRouter |
API cost
Estimated cost of 1M input + 1M output tokens via OpenRouter
Llama-3.1-70B-Instruct
$0.80
Download trend
Daily snapshots, last 90 days (28 Jul – 25 Oct)
1.0 M140 K
Llama-3.1-70B-Instruct
Meta-Llama-3.1-70B-Instruct-AWQ-INT4
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
Llama-3.1-70B-Instruct · fp16
166.3 GB / 24 GB
Meta-Llama-3.1-70B-Instruct-AWQ-INT4 · fp16 @ 128K ctx
213.6 GB / 24 GB
Adjacent comparisons
Llama-3.1-70B-Instruct vs DeepSeek-R1-Distill-Llama-70B
Qwen3-32B-AWQ vs Llama-3.1-70B-Instruct
Qwen2.5-Coder-32B-Instruct-AWQ vs Llama-3.1-70B-Instruct
Gemma-4-31B-IT-NVFP4 vs Llama-3.1-70B-Instruct
OTel-2.0-LLM-31B-IT vs Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Qwen2.5-72B-Instruct-AWQ vs Llama-3.1-70B-Instruct