Llama-3.1-8B-Instruct vs Qwen2.5-VL-7B-Instruct-NVFP4

Specs, VRAM requirements and download trends — updated 10 November 2026.

meta-llama · A · Open weights
Params
8.0 B
Context
—
30d
4.5 M
llama3.1 licence · conditional
nvidia · B · Open weights
Params
5.0 B
Context
128,000
30d
1.2 M

Specification comparison

Differences are highlighted; identical values are muted.

Specification Llama-3.1-8B-Instruct Qwen2.5-VL-7B-Instruct-NVFP4
Deployment Open weights · also via API Open weights
Parameters 8.0 B 5.0 B
Architecture LlamaForCausalLM Qwen2_5_VLForConditionalGeneration
Context length 131,072 128,000
Licence llama3.1 other
Commercial use Conditional Unknown
Languages 8 —
Downloads 30d 4,504,499 1,227,301
Downloads all time 193.6 M 3.2 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated Yes — accept licence No
First seen on the Hub 2024-07-18 2025-09-10
API input price / 1M tokens $0.02 not on OpenRouter
API output price / 1M tokens $0.04 not on OpenRouter
Est. cost per 1M input + 1M output tokens $0.06 not on OpenRouter
Cached input / 1M tokens — not on OpenRouter
AA Intelligence Index — not on OpenRouter
AA Coding Index 5.4 not on OpenRouter
AA Agentic Index — not on OpenRouter
Max output tokens 16,384 not on OpenRouter
API providers 4 not on OpenRouter
Tool calling Yes not on OpenRouter
Reasoning mode No not on OpenRouter

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

Llama-3.1-8B-Instruct $0.06

Download trend

Daily snapshots, last 90 days (13 Aug – 10 Nov)

7.6 M219 K
Llama-3.1-8B-Instruct Qwen2.5-VL-7B-Instruct-NVFP4

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Llama-3.1-8B-Instruct · fp16 19.4 GB / 24 GB
✅ Runs comfortably
Qwen2.5-VL-7B-Instruct-NVFP4 · fp16 @ 125K ctx 20.2 GB / 24 GB
⚠️ Tight — reduce context

Adjacent comparisons