Index-Translate-9B-GGUF
Official GGUF conversion of IndexTeam/Index-Translate-9B, part of the Index-Translate multilingual translation model family (150 languages, terminology/format-constrained translation, controlled dubbing translation, long-document translation).
Params
9.0 B
Context
—
Downloads 30d
50 K
Likes
16
Download history
daily snapshots · 9 days50 K30 K
Oct 16Oct 19Oct 22Oct 24
Can you run it?
Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.
| File | Quant | Size | Est. VRAM | Verdict on RTX 4090 · 24 GB |
|---|---|---|---|---|
| Index-Translate-9B.Q2_K.gguf | Q2_K | 3.9 GB | 6.2 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q3_K_S.gguf | Q3_K_S | 4.4 GB | 6.7 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q3_K_M.gguf | Q3_K_M | 4.7 GB | 7.1 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q3_K_L.gguf | Q3_K_L | 5.0 GB | 7.4 GB | ✅ Runs comfortably |
| Index-Translate-9B.IQ4_XS.gguf | IQ4_XS | 5.4 GB | 7.7 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q4_K_S.gguf | Q4_K_S | 5.5 GB | 7.9 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q4_K_M.gguf | Q4_K_M | 5.8 GB | 8.2 GB | ✅ Runs comfortably |
| Index-Translate-9B.Q5_K_M.gguf | Q5_K_M | 6.6 GB | 9.2 GB | ✅ Runs comfortably |
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.
Specifications
- Parameters
- 9.0 B
- Licence
- apache-2.0
- First seen on the Hub
- 2026-10-02
- Training datasets
- undisclosed
- Added to our catalog
- 2026-10-16
Compare with any translation model