allenai / feature-extraction updated 1 year ago

specter2_base

Name: specter2_base
Author: allenai

SPECTER2 is the successor to SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. This is the base model to be used along with the adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications.

Params

—

Context

512

Downloads 30d

873 K

Likes

Commercial use: allowed apache-2.0 Not gated 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

986 K871 K

Jul 28Jul 31Aug 3Aug 6

Specifications

Architecture: BertModel
Context length: 512
Vocabulary: 31,090
Layers / heads: 12 / 12
Licence: apache-2.0
First seen on the Hub: 2023-02-16
Training datasets: allenai/scirepeval
Added to our catalog: 2026-07-28

Compare with

bge-small-en-v1.5 72.4 M bge-large-en-v1.5 13.1 M bge-base-en-v1.5 10.0 M Qwen3-Embedding-0.6B 9.8 M multilingual-e5-large 7.5 M mxbai-embed-large-v1 4.9 M

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB