Llama-3.1-8B-Instruct vs bge-reranker-v2.5-gemma2-lightweight-gptq
Specs, VRAM requirements and download trends — updated 20 September 2026.
Specification comparison
Differences are highlighted; identical values are muted.
| Specification | Llama-3.1-8B-Instruct | bge-reranker-v2.5-gemma2-lightweight-gptq |
|---|---|---|
| Parameters | 8.0 B | 9.2 B |
| Architecture | LlamaForCausalLM | CostWiseGemmaForCausalLM |
| Context length | — | 8,192 |
| Licence | llama3.1 | — |
| Commercial use | Conditional | Unknown |
| Languages | 8 | — |
| Downloads 30d | 5,919,746 | 533,952 |
| Downloads all time | 184.9 M | 534 K |
| Quantizations on the Hub | SAFETENSORS | SAFETENSORS |
| Gated | Yes — accept licence | No |
| First seen on the Hub | 2024-07-18 | 2024-09-13 |
Download trend
Daily snapshots, last 55 days (28 Jul – 20 Sep)
8.0 M256 K
Llama-3.1-8B-Instruct
bge-reranker-v2.5-gemma2-lightweight-gptq
VRAM side by side
On RTX 4090 · 24 GB · 8K context unless noted
bge-reranker-v2.5-gemma2-lightweight-gptq · fp16
8.7 GB / 24 GB
Llama-3.1-8B-Instruct · fp16
19.4 GB / 24 GB