specter2_base
SPECTER2 is the successor to SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. This is the base model to be used along with the adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications.
Params
—
Context
512
Downloads 30d
1.2 M
Likes
48
Download history
daily snapshots · 55 days
▲ 483 K in the last 30 days (71.2%)
1.2 M629 K
Aug 22Sep 1Sep 11Sep 20
1.2 M629 K
Jul 28Aug 15Sep 2Sep 20
Specifications
- Architecture
- BertModel
- Context length
- 512
- Vocabulary
- 31,090
- Layers / heads
- 12 / 12
- Licence
- apache-2.0
- First seen on the Hub
- 2023-02-16
- Training datasets
- allenai/scirepeval
- Added to our catalog
- 2026-07-28
Compare with any feature-extraction model