Unbabel / translation updated 2 years ago

TowerInstruct-13B-v0.1

TowerInstruct-13B is a language model that results from fine-tuning TowerBase on the TowerBlocks supervised fine-tuning dataset. TowerInstruct-13B-v0.1 is the first model in the series. The model is trained to handle several translation-related tasks, such as general machine translation (e.g., sentence- and paragraph/document-level translation, terminology-aware translation, context-aware translation), automatic post...

Params
13.0 B
Context
4,096
Downloads 30d
94 K
Likes
35
Commercial use: not allowed · cc-by-nc-4.0 Not gated SAFETENSORS 10 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days
94 K94 K
Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

FileQuantSizeEst. VRAMVerdict on RTX 4090 · 24 GB
model.safetensors f32 52.1 GB 59.7 GB ❌ Won’t fit
Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture
LlamaForCausalLM
Parameters
13.0 B
Tensor type
F32
Context length
4,096
Vocabulary
32,007
Layers / heads
40 / 40
Licence
cc-by-nc-4.0
First seen on the Hub
2024-01-29
Training datasets
undisclosed
Added to our catalog
2026-07-28