Ethio-ASR-mms-1b-uf
Reproduction of MMS-1B fine-tune. Matches the paper-published checkpoint within noise (-0.02% macro WER).
This model is part of an independent reproduction of Ethio-ASR
(Abdullah et al., 2026) carried out at the University of Florida on
the HiPerGator HPC cluster (NVIDIA B200 GPUs). It is fine-tuned from
facebook/mms-1b on the
WAXAL Ethiopian subset
covering Amharic, Tigrinya, Oromo, Sidaama and Wolaytta.
Performance
Word Error Rate on the WAXAL test split (18 810 utterances), with paper-faithful post-processing (Ge'ez homophone collapse + punctuation removal):
| Language | WER (%) |
|---|---|
| Amharic | 28.15 |
| Oromo | 25.07 |
| Sidaama | 30.44 |
| Tigrinya | 39.97 |
| Wolaytta | 37.03 |
| Macro avg | 32.13 |
Without post-processing the macro WER is 35.69% (raw model output).
Usage
from transformers import AutoProcessor, AutoModelForCTC
import torch, librosa
REPO = "boazsew/Ethio-ASR-mms-1b-uf"
processor = AutoProcessor.from_pretrained(REPO)
model = AutoModelForCTC.from_pretrained(REPO, torch_dtype=torch.bfloat16).to("cuda").eval()
# Load any 16 kHz audio
audio, sr = librosa.load("your_audio.wav", sr=16000, mono=True)
inputs = processor(audio, sampling_rate=16000, return_tensors="pt")
key = "input_features" if "input_features" in inputs else "input_values"
in_kwargs = {key: inputs[key].to("cuda", dtype=torch.bfloat16)}
if "attention_mask" in inputs:
in_kwargs["attention_mask"] = inputs["attention_mask"].to("cuda")
with torch.no_grad():
logits = model(**in_kwargs).logits
pred_ids = logits.argmax(dim=-1)
text = processor.batch_decode(pred_ids)[0]
print(text) # starts with [AMH]/[TIR]/[ORM]/[WAL]/[SID] language tag
Training details
- Encoder:
facebook/mms-1b(1B parameters) - Dataset:
badrex/waxalNLP-ethiopic-final(~1106 h, 5 Ethiopian languages) - Max steps: 36 800 (≈7 epochs, effective batch size 32)
- Hardware: 1 × NVIDIA B200
- Optimizer: AdamW, linear warmup over 10 % of steps, mixed-precision bf16 (except AfriHuBERT which used fp32)
- CTC objective with prepended [LANG] token (joint LID + ASR)
Citation
If you use this model please cite both the original paper and the reproduction:
@article{abdullah2026ethioasr,
title={Ethio-ASR: Joint Multilingual Speech Recognition and Language
Identification for Ethiopian Languages},
author={Abdullah, Badr M. and others},
journal={arXiv preprint arXiv:2603.23654},
year={2026}
}
Full reproduction code, configs and evaluation utilities are at
https://github.com/boaztulu/Ethio-ASR under reproduction_uf/.
License
CC-BY-NC-4.0 — inherits from the upstream facebook/mms-1b license.