Llama-3.1-8B-Instruct vs OLMoE-1B-7B-0125-Instruct

Specs, VRAM requirements and download trends — updated 25 October 2026.

meta-llama · A · Open weights
Params
8.0 B
Context
—
30d
4.9 M
llama3.1 licence · conditional
allenai · B · Open weights
Params
6.9 B
Context
4,096
30d
201 K
apache-2.0 · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Llama-3.1-8B-Instruct OLMoE-1B-7B-0125-Instruct
Deployment Open weights · also via API Open weights
Parameters 8.0 B 6.9 B
Architecture LlamaForCausalLM OlmoeForCausalLM
Context length 131,072 4,096
Licence llama3.1 apache-2.0
Commercial use Conditional Allowed
Languages 8 1
Downloads 30d 4,880,965 200,533
Downloads all time 191.2 M 1.1 M
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated Yes — accept licence No
First seen on the Hub 2024-07-18 2025-01-27
API input price / 1M tokens $0.05 not on OpenRouter
API output price / 1M tokens $0.08 not on OpenRouter
Est. cost per 1M input + 1M output tokens $0.13 not on OpenRouter
Cached input / 1M tokens $0.025 not on OpenRouter
AA Intelligence Index 6.9 not on OpenRouter
AA Coding Index 5.4 not on OpenRouter
AA Agentic Index — not on OpenRouter
Max output tokens 117,964 not on OpenRouter
API providers 5 not on OpenRouter
Tool calling Yes not on OpenRouter
Reasoning mode No not on OpenRouter

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

Llama-3.1-8B-Instruct $0.13

Download trend

Daily snapshots, last 90 days (28 Jul – 25 Oct)

8.0 M162 K
Llama-3.1-8B-Instruct OLMoE-1B-7B-0125-Instruct

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

OLMoE-1B-7B-0125-Instruct · fp16 16.8 GB / 24 GB
✅ Runs comfortably
Llama-3.1-8B-Instruct · fp16 19.4 GB / 24 GB
✅ Runs comfortably

Adjacent comparisons