nvidia / text-generation updated 1 year ago

Nemotron-Mini-4B-Instruct

Name: Nemotron-Mini-4B-Instruct
Author: nvidia

Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment. It is a fine-tuned version of nvidia/Minitron-4B-Base, which was pruned and distilled from Nemotron-4 15B using our LLM compression technique. This instruct mo...

Params

—

Context

4,096

Downloads 30d

170 K

Likes

186

Licence: other Not gated 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

229 K170 K

Jul 28Jul 31Aug 3Aug 6

Run it

copy-paste, exact tags checked against the Hub

~ · curl · api/v1

$ curl -s https://aimodelscomparison.com/api/v1/models/nemotron-mini-4b-instruct
{
  "hf_id": "nvidia/Nemotron-Mini-4B-Instruct",
  "params_b": null,
  "context_length": 4096,
  "license": { "id": "other", "commercial": "unknown" },
  "downloads_30d": 170473,
  "vram_estimates": [

  ],
  "updated_at": "2026-08-01T04:00:25Z"
}

est. VRAM —on RTX 4090 · 24 GBJSON API →

Specifications

Architecture: NemotronForCausalLM
Context length: 4,096
Vocabulary: 256,000
Layers / heads: 32 / 24
Licence: other
First seen on the Hub: 2024-09-10
Training datasets: undisclosed
Added to our catalog: 2026-07-28

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB