internlm / text-classification updated 1 year ago

internlm2-1_8b-reward

InternLM2-1.8B-Reward is a reward model trained on the foundation of InternLM2-Chat-1.8B-SFT. This model has been trained using over 2.4 million preference samples, both human-annotated and AI-synthesized, achieving outstanding performance while ensuring a balance between helpful and harmless.

Params
1.7 B
Context
32,768
Downloads 30d
254 K
Likes
16
Licence: other Not gated SAFETENSORS 2 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
279 K246 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f16 3.4 GB 4.5 GB ✅ Runs comfortably
model.safetensors (bf16, full) bf16 + 32K ctx 3.4 GB 5.3 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
InternLM2ForRewardModel
Parameters
1.7 B
Tensor type
F16
Context length
32,768
Vocabulary
92,544
Layers / heads
24 / 16
Licence
other
First seen on the Hub
2024-06-27
Training datasets
undisclosed
Added to our catalog
2026-07-28