microsoft / text-classification updated 5 years ago

deberta-large-mnli

Name: deberta-large-mnli
Author: microsoft

DeBERTa improves the BERT and RoBERTa models using disentangled attention and enhanced mask decoder. It outperforms BERT and RoBERTa on majority of NLU tasks with 80GB training data.

Params

—

Context

512

Downloads 30d

274 K

Likes

Commercial use: allowed mit Not gated 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

276 K266 K

Jul 28Jul 31Aug 3Aug 6

Specifications

Architecture: DebertaForSequenceClassification
Context length: 512
Vocabulary: 50,265
Layers / heads: 24 / 16
Licence: mit
First seen on the Hub: 2022-03-02
Training datasets: undisclosed
Added to our catalog: 2026-07-28

Compare with

bge-reranker-v2-m3 19.2 M finbert 5.6 M bge-reranker-base 4.6 M Prompt-Guard-86M 4.5 M distilbert-base-uncased-finetuned-sst-2-english 3.7 M koelectra-small-v3-nsmc 2.9 M

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB