sentence-transformers / sentence-similarity updated 1 year ago

msmarco-bert-base-dot-v5

Name: msmarco-bert-base-dot-v5
Author: sentence-transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and was designed for semantic search. It has been trained on 500K (query, answer) pairs from the MS MARCO dataset. For an introduction to semantic search, have a look at: SBERT.net - Semantic Search

Params

110 M

Context

512

Downloads 30d

557 K

Likes

Licence: unknown Not gated SAFETENSORS 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

607 K557 K

Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
model.safetensors	f32	0.4 GB	1.0 GB	✅ Runs comfortably

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture: BertModel
Parameters: 110 M
Tensor type: F32
Context length: 512
Vocabulary: 30,522
Layers / heads: 12 / 12
First seen on the Hub: 2022-03-02
Training datasets: undisclosed
Added to our catalog: 2026-07-28

Compare with

all-MiniLM-L6-v2 257.8 M paraphrase-multilingual-MiniLM-L12-v2 59.4 M bge-m3 35.0 M all-mpnet-base-v2 25.2 M nomic-embed-text-v1.5 15.7 M multilingual-e5-small 15.6 M

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB