Llama-3.1-8B-Instruct vs Ling-3.0-tiny-MLX-4bit

Specs, VRAM requirements and download trends — updated 24 October 2026.

meta-llama · A · Open weights
Params
8.0 B
Context
—
30d
4.9 M
llama3.1 licence · conditional
rapid-mlx · B · Open weights
Params
7.9 B
Context
131,072
30d
372 K
mit · commercial OK

Specification comparison

Differences are highlighted; identical values are muted.

Specification Llama-3.1-8B-Instruct Ling-3.0-tiny-MLX-4bit
Deployment Open weights · also via API Open weights
Parameters 8.0 B 7.9 B
Architecture LlamaForCausalLM BailingMoeV3ForCausalLM
Context length 131,072 131,072
Licence llama3.1 mit
Commercial use Conditional Allowed
Languages 8 —
Downloads 30d 4,864,172 371,517
Downloads all time 191.0 M 378 K
Quantizations on the Hub SAFETENSORS SAFETENSORS
Gated Yes — accept licence No
First seen on the Hub 2024-07-18 2026-08-11
API input price / 1M tokens $0.05 not on OpenRouter
API output price / 1M tokens $0.08 not on OpenRouter
Est. cost per 1M input + 1M output tokens $0.13 not on OpenRouter
Cached input / 1M tokens $0.025 not on OpenRouter
AA Intelligence Index 6.9 not on OpenRouter
AA Coding Index 5.4 not on OpenRouter
AA Agentic Index — not on OpenRouter
Max output tokens 117,964 not on OpenRouter
API providers 5 not on OpenRouter
Tool calling Yes not on OpenRouter
Reasoning mode No not on OpenRouter

API cost

Estimated cost of 1M input + 1M output tokens via OpenRouter

Llama-3.1-8B-Instruct $0.13

Download trend

Daily snapshots, last 89 days (28 Jul – 24 Oct)

8.0 M175 K
Llama-3.1-8B-Instruct Ling-3.0-tiny-MLX-4bit

VRAM side by side

On RTX 4090 · 24 GB · 8K context unless noted

Llama-3.1-8B-Instruct · fp16 19.4 GB / 24 GB
✅ Runs comfortably
Ling-3.0-tiny-MLX-4bit · fp16 @ 128K ctx 24.3 GB / 24 GB
❌ Won’t fit

Adjacent comparisons