bkai-foundation-models / sentence-similarity updated 2 years ago

vietnamese-bi-encoder

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.

Params
130 M
Context
256
Downloads 30d
492 K
Likes
78
Commercial use: allowed apache-2.0 Not gated SAFETENSORS 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
501 K489 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 0.5 GB 1.1 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
RobertaModel
Parameters
130 M
Tensor type
F32
Context length
256
Vocabulary
64,001
Layers / heads
12 / 12
Licence
apache-2.0
First seen on the Hub
2023-09-09
Training datasets
undisclosed
Added to our catalog
2026-07-28