NousResearch / text-generation updated 2 years ago

Llama-2-7b-hf

Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B pretrained model, converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom.

Params
6.7 B
Context
4,096
Downloads 30d
335 K
Likes
176
Licence: unknown Not gated SAFETENSORS 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
335 K309 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f16 13.5 GB 16.3 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub
~ · curl · api/v1
$ curl -s https://aimodelscomparison.com/api/v1/models/llama-2-7b-hf-nousresearch
{
  "hf_id": "NousResearch/Llama-2-7b-hf",
  "params_b": 6.74,
  "context_length": 4096,
  "license": { "id": "", "commercial": "unknown" },
  "downloads_30d": 335067,
  "vram_estimates": [
    { "quant": "f16", "gb": 16.3 }
  ],
  "updated_at": "2026-07-28T18:06:24Z"
}
est. VRAM —on RTX 4090 · 24 GBJSON API →

Specifications

Architecture
LlamaForCausalLM
Parameters
6.7 B
Tensor type
F16
Context length
4,096
Vocabulary
32,000
Layers / heads
32 / 32
First seen on the Hub
2023-07-18
Training datasets
undisclosed
Added to our catalog
2026-07-28