lxyuan / text-classification updated 1 year ago

distilbert-base-multilingual-cased-sentiments-student

This model is distilled from the zero-shot classification pipeline on the Multilingual Sentiment dataset using this script.

Params
140 M
Context
512
Downloads 30d
917 K
Likes
315
Commercial use: allowed apache-2.0 Not gated SAFETENSORS 12 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
930 K880 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 0.5 GB 1.1 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
DistilBertForSequenceClassification
Parameters
140 M
Tensor type
F32
Context length
512
Vocabulary
119,547
Licence
apache-2.0
First seen on the Hub
2023-05-05
Training datasets
tyqiangz/multilingual-sentiments
Added to our catalog
2026-07-28