Llama-3.1-Nemotron-Nano-8B-v1
Llama-3.1-Nemotron-Nano-8B-v1 is a large language model (LLM) which is a derivative of Meta Llama-3.1-8B-Instruct (AKA the reference model). It is a reasoning model that is post trained for reasoning, human chat preferences, and tasks, such as RAG and tool calling.
Params
8.0 B
Context
131,072
Downloads 30d
218 K
Likes
224
Download history
daily snapshots · 39 days
▲ 29 K in the last 30 days (15.5%)
220 K198 K
Aug 23Sep 2Sep 12Sep 21
220 K174 K
Aug 14Aug 27Sep 9Sep 21
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| model.safetensors | bf16 | 16.1 GB | 19.4 GB | ✅ Runs comfortably |
| model.safetensors (bf16, full) | bf16 + 128K ctx | 16.1 GB | 37.4 GB | ❌ Won’t fit |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Run it
copy-paste, exact tags checked against the Hub$ curl -s https://aimodelscomparison.com/api/v1/models/llama-3-1-nemotron-nano-8b-v1
{
"hf_id": "nvidia/Llama-3.1-Nemotron-Nano-8B-v1",
"params_b": 8.03,
"context_length": 131072,
"license": { "id": "other", "commercial": "unknown" },
"downloads_30d": 218118,
"vram_estimates": [
{ "quant": "bf16", "gb": 19.4 }
],
"updated_at": "2026-08-14T01:00:50Z"
}
Specifications
- Architecture
- LlamaForCausalLM
- Parameters
- 8.0 B
- Tensor type
- BF16
- Context length
- 131,072
- Vocabulary
- 128,256
- Layers / heads
- 32 / 32
- Licence
- other
- First seen on the Hub
- 2025-03-16
- Training datasets
- undisclosed
- Added to our catalog
- 2026-08-14
Compare with any text-generation model