FremyCompany / sentence-similarity updated 1 year ago

BioLORD-2023

πŸ™ If you are able to, please help me fund my open research. πŸ™ Thank you for your generosity! πŸ€— -----------------------------------------------------------------------------------------------------------------------------------

Params
110 M
Context
512
Downloads 30d
446 K
Likes
57
Licence: other Not gated SAFETENSORS 1 languages View on Hugging Face β†—

Download history

daily snapshots Β· 8 days
446 K436 K
Jul 31Aug 2Aug 5Aug 7

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 Β· 24 GB
model.safetensors f32 0.4 GB 1.0 GB βœ… Runs comfortably
Estimate: file size Γ— 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark β€” how we calculate this.

Specifications

Architecture
MPNetModel
Parameters
110 M
Tensor type
F32
Context length
512
Vocabulary
30,527
Layers / heads
12 / 12
Licence
other
First seen on the Hub
2023-11-27
Training datasets
FremyCompany/BioLORD-Dataset, FremyCompany/AGCT-Dataset
Added to our catalog
2026-07-31