svara-whisper-small-hi-ct2
cruqAI/svara-whisper-small-hi converted to CTranslate2 with int8 weights, for CPU inference with faster-whisper or the CTranslate2 Whisper API.
Scored on FLEURS Hindi test (418 utterances) with the same normalisation as the source model's card, on one box:
| WER | CER | |
|---|---|---|
| source model, fp16 on GPU | 0.475 | 0.198 |
| this export, int8 on CPU | 0.489 | 0.205 |
Real-time factor of this export on 4 CPU threads, greedy decoding, feature extraction included: 0.173 (4832 s of audio in 837 s).
from faster_whisper import WhisperModel
model = WhisperModel("cruqAI/svara-whisper-small-hi-ct2", device="cpu", compute_type="int8", cpu_threads=4)
segments, info = model.transcribe("clip.wav", language="hi")
print(" ".join(s.text for s in segments))
Licence and training details are on the source model's card.