lxyuan / text-classification Open weights updated 1 year ago

distilbert-base-multilingual-cased-sentiments-student

This model is distilled from the zero-shot classification pipeline on the Multilingual Sentiment dataset using this script.

Params
140 M
Context
512
Downloads 30d
795 K
Likes
317
Commercial use: allowed apache-2.0 Not gated SAFETENSORS 12 languages View on Hugging Face ↗

Download history

daily snapshots · 106 days
▲ 231 K in the last 30 days (40.9%)
1.1 M502 K
Jul 28Sep 1Oct 6Nov 10

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 0.5 GB 1.1 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
DistilBertForSequenceClassification
Parameters
140 M
Tensor type
F32
Context length
512
Vocabulary
119,547
Licence
apache-2.0
First seen on the Hub
2023-05-05
Training datasets
tyqiangz/multilingual-sentiments
Added to our catalog
2026-07-28
Compare with any text-classification model