Llama-3.1-8B-Instruct vs llama-3-8b-Instruct-bnb-4bit
Specs, VRAM requirements and download trends — updated 25 October 2026.
meta-llama · A · Open weights
Params
8.0 B
Context
—
30d
4.9 M
llama3.1 licence · conditional
unsloth · B · Open weights
Params
8.2 B
Context
8,192
30d
247 K
llama3 licence · conditional
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Llama-3.1-8B-Instruct | llama-3-8b-Instruct-bnb-4bit |
|---|---|---|
| Deployment | Open weights · also via API | Open weights |
| Parameters | 8.0 B | 8.2 B |
| Architecture | LlamaForCausalLM | LlamaForCausalLM |
| Context length | 131,072 | 8,192 |
| Licence | llama3.1 | llama3 |
| Commercial use | Conditional | Conditional |
| Languages | 8 | 1 |
| Downloads 30d | 4,880,965 | 247,159 |
| Downloads all time | 191.2 M | 3.9 M |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | Yes — accept licence | No |
| First seen on the Hub | 2024-07-18 | 2024-04-18 |
| API input price / 1M tokens | $0.05 | not on OpenRouter |
| API output price / 1M tokens | $0.08 | not on OpenRouter |
| Est. cost per 1M input + 1M output tokens | $0.13 | not on OpenRouter |
| Cached input / 1M tokens | $0.025 | not on OpenRouter |
| AA Intelligence Index | 6.9 | not on OpenRouter |
| AA Coding Index | 5.4 | not on OpenRouter |
| AA Agentic Index | — | not on OpenRouter |
| Max output tokens | 117,964 | not on OpenRouter |
| API providers | 5 | not on OpenRouter |
| Tool calling | Yes | not on OpenRouter |
| Reasoning mode | No | not on OpenRouter |
API cost
Estimated cost of 1M input + 1M output tokens via OpenRouter
Llama-3.1-8B-Instruct
$0.13
Download trend
Daily snapshots, last 90 days (28 Jul – 25 Oct)
8.0 M155 K
Llama-3.1-8B-Instruct
llama-3-8b-Instruct-bnb-4bit
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
llama-3-8b-Instruct-bnb-4bit · fp16
8.0 GB / 24 GB
Llama-3.1-8B-Instruct · fp16
19.4 GB / 24 GB