jason9693 / text-classification updated 1 year ago

Qwen2.5-1.5B-apeach

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

Params
1.5 B
Context
131,072
Downloads 30d
431 K
Likes
6
Licence: unknown Not gated SAFETENSORS View on Hugging Face ↗

Download history

daily snapshots · 10 days
442 K412 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 6.2 GB 7.5 GB ✅ Runs comfortably
model.safetensors (bf16, full) bf16 + 128K ctx 6.2 GB 11.0 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
Qwen2ForSequenceClassification
Parameters
1.5 B
Tensor type
F32
Context length
131,072
Vocabulary
151,936
Layers / heads
28 / 12
First seen on the Hub
2024-10-24
Training datasets
undisclosed
Added to our catalog
2026-07-28