laion / audio-classification updated 6 months ago

clap-htsat-fused

Name: clap-htsat-fused
Author: laion

> Contrastive learning has shown remarkable success in the field of multimodal representation learning. In this paper, we propose a pipeline of contrastive language-audio pretraining to develop an audio representation by combining audio data with natural language descriptions. To accomplish this target, we first release LAION-Audio-630K, a large collection of 633,526 audio-text pairs from different data sources. Seco...

Params

150 M

Context

—

Downloads 30d

6.9 M

Likes

121

Commercial use: allowed apache-2.0 Not gated SAFETENSORS 1 languages View on Hugging Face ↗

Download history

daily snapshots · 10 days

8.4 M6.7 M

Jul 28Jul 31Aug 3Aug 6

Can you run it?

Estimated VRAM at 8K context unless noted. Pick your hardware to see the verdict per quantization.

File	Quant	Size	Est. VRAM	Verdict on RTX 4090 · 24 GB
model.safetensors	f32	0.6 GB	1.2 GB	✅ Runs comfortably

Estimate: file size × 1.1 + KV cache at 8K + 0.5 GB overhead. Not a benchmark — how we calculate this.

Specifications

Architecture: ClapModel
Parameters: 150 M
Tensor type: F32
Licence: apache-2.0
First seen on the Hub: 2023-02-16
Training datasets: undisclosed
Added to our catalog: 2026-07-28

Compare with

ast-finetuned-audioset-10-10-0.4593 1.2 M wav2vec2-large-robust-12-ft-emotion-msp-dim 751 K wav2vec2-large-xlsr-53-gender-recognition-librispeech 626 K MERT-v1-330M 560 K audiobox-aesthetics 401 K MuQ-large-msd-iter 292 K

Appears in

Best open coding models Commercial-use text models Models that fit in 12 GB