msmarco-distilbert-base-tas-b
This is a port of the DistilBert TAS-B Model to sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and is optimized for the task of semantic search.
Params
66 M
Context
512
Downloads 30d
463 K
Likes
44
Download history
tracking started — chart appears after 7 days of snapshots (3 recorded)463 K downloads in the last 30 days
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| model.safetensors | f32 | 0.3 GB | 0.8 GB | ✅ Runs comfortably |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Specifications
- Architecture
- DistilBertModel
- Parameters
- 66 M
- Tensor type
- F32
- Context length
- 512
- Vocabulary
- 30,522
- Licence
- apache-2.0
- First seen on the Hub
- 2022-03-02
- Training datasets
- ms_marco
- Added to our catalog
- 2026-09-19
Compare with any sentence-similarity model