huggyllama / text-generation updated 2 years ago

llama-7b

Name: llama-7b
Author: huggyllama

This contains the weights for the LLaMA-7b model. This model is under a non-commercial license (see the LICENSE file). You should only use this repository if you have been granted access to the model by filling out this form but either lost your copy of the weights or got some trouble converting them to the Transformers format.

Params

6.7 B

Context

2,048

Downloads 30d

288 K

Likes

360

Licence: other Not gated SAFETENSORS View on Hugging Face ↗

Download history

daily snapshots · 10 days

303 K287 K

Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
model.safetensors	f16	13.5 GB	16.3 GB	✅ Runs comfortably

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Run it

copy-paste, exact tags checked against the Hub

~ · curl · api/v1

$ curl -s https://aimodelscomparison.com/api/v1/models/llama-7b
{
  "hf_id": "huggyllama/llama-7b",
  "params_b": 6.74,
  "context_length": 2048,
  "license": { "id": "other", "commercial": "unknown" },
  "downloads_30d": 288309,
  "vram_estimates": [
    { "quant": "f16", "gb": 16.3 }
  ],
  "updated_at": "2026-07-28T18:06:36Z"
}

est. VRAM —on RTX 4090 · 24 GBJSON API →

Specifications

Architecture: LlamaForCausalLM
Parameters: 6.7 B
Tensor type: F16
Context length: 2,048
Vocabulary: 32,000
Layers / heads: 32 / 32
Licence: other
First seen on the Hub: 2023-04-03
Training datasets: undisclosed
Added to our catalog: 2026-07-28

Compare with

Qwen3-8B 16.3 M Qwen2.5-7B-Instruct 12.1 M Qwen3.6-35B-A3B-NVFP4 11.3 M Llama-3.1-8B-Instruct 8.0 M Qwen2.5-7B-Instruct-AWQ 4.6 M granite-4.1-8b 4.2 M

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB