LocalAI-io / token-classification updated 3 months ago

privacy-filter-multilingual-GGUF

GGUF conversion of OpenMed/privacy-filter-multilingual, a multilingual PII token-classification model (a fine-tune of openai/privacy-filter). It labels every token with a BIOES tag over 54 PII categories (217 classes) across 16 languages, so it can be served locally with no Python as the encoder/NER tier of a PII redactor.

Params
Context
Downloads 30d
368 K
Likes
6
Commercial use: allowed apache-2.0 Not gated GGUF 16 languages View on Hugging Face ↗

Download history

daily snapshots · 27 days
380 K252 K
Aug 25Sep 3Sep 12Sep 20

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
privacy-filter-multilingual-q8.gguf Q8 1.6 GB 2.3 GB ✅ Runs comfortably
privacy-filter-multilingual-f16.gguf GGUF 2.8 GB 3.6 GB ✅ Runs comfortably
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Licence
apache-2.0
First seen on the Hub
2026-06-04
Training datasets
undisclosed
Added to our catalog
2026-08-25
Compare with any token-classification model