FremyCompany / sentence-similarity updated 1 year ago

BioLORD-2023

πŸ™ If you are able to, please help me fund my open research. πŸ™ Thank you for your generosity! πŸ€— -----------------------------------------------------------------------------------------------------------------------------------

Params
110 M
Context
512
Downloads 30d
437 K
Likes
57
Licence: other Not gated SAFETENSORS 1 languages View on Hugging Face β†—

Download history

daily snapshots Β· 53 days
β–² 5 K in the last 30 days (1.1%)
458 K398 K
Jul 31Aug 17Sep 4Sep 21

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 Β· 24 GB
model.safetensors f32 0.4 GB 1.0 GB βœ… Runs comfortably
Estimate: file size Γ— 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark β€” how we calculate this.

Specifications

Architecture
MPNetModel
Parameters
110 M
Tensor type
F32
Context length
512
Vocabulary
30,527
Layers / heads
12 / 12
Licence
other
First seen on the Hub
2023-11-27
Training datasets
FremyCompany/BioLORD-Dataset, FremyCompany/AGCT-Dataset
Added to our catalog
2026-07-31
Compare with any sentence-similarity model