unslothai / feature-extraction updated 2 years ago

vram-16

Params
Context
Downloads 30d
410 K
Likes
0
Licence: unknown Not gated SAFETENSORS View on Hugging Face ↗

Download history

daily snapshots · 56 days
▲ 19 K in the last 30 days (4.4%)
469 K403 K
Jul 28Aug 15Sep 3Sep 21

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 0.0 GB 0.5 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
LlamaModel
Tensor type
F32
First seen on the Hub
2024-07-07
Training datasets
undisclosed
Added to our catalog
2026-07-28
Compare with any feature-extraction model