specter2_base
SPECTER2 is the successor to SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. This is the base model to be used along with the adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications.
Params
—
Context
512
Downloads 30d
662 K
Likes
57
Download history
daily snapshots · 106 days
▲ 318 K in the last 30 days (32.5%)
978 K662 K
Oct 12Oct 22Nov 1Nov 10
1.2 M629 K
Aug 13Sep 12Oct 12Nov 10
1.2 M629 K
Jul 28Sep 1Oct 6Nov 10
Specifications
- Architecture
- BertModel
- Context length
- 512
- Vocabulary
- 31,090
- Layers / heads
- 12 / 12
- Licence
- apache-2.0
- First seen on the Hub
- 2023-02-16
- Training datasets
- allenai/scirepeval
- Added to our catalog
- 2026-07-28
Compare with any feature-extraction model