Llama-3.1-8B-Instruct
The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out). The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks.
Params
8.0 B
Context
131,072
Downloads 30d
177 K
Likes
17
Download history
daily snapshots · 8 days177 K167 K
Oct 18Oct 20Oct 23Oct 25
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| model.safetensors | bf16 | 16.1 GB | 19.4 GB | ✅ Runs comfortably |
| model.safetensors (bf16, full) | bf16 + 128K ctx | 16.1 GB | 37.4 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Run it
copy-paste, exact tags checked against the Hub$ curl -s https://aimodelscomparison.com/api/v1/models/llama-3-1-8b-instruct-unsloth
{
"hf_id": "unsloth/Llama-3.1-8B-Instruct",
"params_b": 8.03,
"context_length": 131072,
"license": { "id": "llama3.1", "commercial": "conditional" },
"downloads_30d": 176516,
"vram_estimates": [
{ "quant": "bf16", "gb": 19.4 }
],
"updated_at": "2026-10-18T01:00:11Z"
}
Specifications
- Architecture
- LlamaForCausalLM
- Parameters
- 8.0 B
- Tensor type
- BF16
- Context length
- 131,072
- Vocabulary
- 128,256
- Layers / heads
- 32 / 32
- Licence
- llama3.1
- First seen on the Hub
- 2025-02-15
- Base model
- Llama-3.1-8B-Instruct
- Training datasets
- undisclosed
- Added to our catalog
- 2026-10-18
Family
Base model and the most-downloaded derivatives in the catalog.
Compare with any text-generation model