Llama-3.1-70B-Instruct vs Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Specs, VRAM requirements and download trends — updated 30 July 2026.

meta-llama · A · Open weights
Params
70.6 B
Context
—
30d
203 K
llama3.1 licence · conditional
hugging-quants · B · Open weights
Params
70.6 B
Context
131,072
30d
140 K
llama3.1 licence · conditional

Specification comparison

Differences are highlighted; identical values are muted.

Specification Llama-3.1-70B-Instruct Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Deployment Open weights · also via API Open weights
Parameters 70.6 B 70.6 B
Architecture LlamaForCausalLM LlamaForCausalLM
Context length 131,072 131,072
Licence llama3.1 llama3.1
Commercial use Conditional Conditional
Languages 8 8
Downloads 30d 203,439 140,116
Downloads all time 24.5 M 5.4 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated Yes — accept licence No
First seen on the Hub 2024-07-16 2024-07-19
API input price / 1M tokens $0.40 not on OpenRouter
API output price / 1M tokens $0.40 not on OpenRouter
Est. cost per 1M input + 1M output tokens $0.80 not on OpenRouter
Cached input / 1M tokens — not on OpenRouter
AA Intelligence Index 6.6 not on OpenRouter
AA Coding Index — not on OpenRouter
AA Agentic Index — not on OpenRouter
Max output tokens 16,384 not on OpenRouter
API providers 2 not on OpenRouter
Tool calling Yes not on OpenRouter
Reasoning mode No not on OpenRouter

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

Llama-3.1-70B-Instruct $0.80

Download trend

Daily snapshots, last 90 days (28 Jul – 25 Oct)

1.0 M140 K
Llama-3.1-70B-Instruct Meta-Llama-3.1-70B-Instruct-AWQ-INT4

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Llama-3.1-70B-Instruct · fp16 166.3 GB / 24 GB
❌ Won’t fit
Meta-Llama-3.1-70B-Instruct-AWQ-INT4 · fp16 @ 128K ctx 213.6 GB / 24 GB
❌ Won’t fit

Adjacent comparisons