indobenchmark / feature-extraction updated 5 years ago

indobert-base-p1

Name: indobert-base-p1
Author: indobenchmark

IndoBERT is a state-of-the-art language model for Indonesian based on the BERT model. The pretrained model is trained using a masked language modeling (MLM) objective and next sentence prediction (NSP) objective.

Params

—

Context

512

Downloads 30d

670 K

Likes

Commercial use: allowed mit Not gated 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

969 K670 K

Jul 28Jul 31Aug 3Aug 6

Specifications

Architecture: BertModel
Context length: 512
Vocabulary: 50,000
Layers / heads: 12 / 12
Licence: mit
First seen on the Hub: 2022-03-02
Training datasets: Indo4B
Added to our catalog: 2026-07-28

Compare with

bge-small-en-v1.5 72.4 M bge-large-en-v1.5 13.1 M bge-base-en-v1.5 10.0 M Qwen3-Embedding-0.6B 9.8 M multilingual-e5-large 7.5 M mxbai-embed-large-v1 4.9 M

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB