mizo-ner-mizbert

micro F1 0.8788 silver; F1 0.6414 gold — our best model against human annotation

Trained on the Mizo NER corpus, 441,178 sentences with silver-standard labels.

Usage

from transformers import pipeline
ner = pipeline("token-classification", model="haulai/mizo-ner-mizbert",
               aggregation_strategy="simple")
print(ner("Pu Lalthanhawla chuan Aizawlah thu a sawi."))

Important

Training labels are silver-standard. Against 300 sentences annotated by two Mizo speakers this model scores substantially lower than on the silver test set; both figures are given above. Treat the silver number as agreement with the projection, not accuracy.

Trained only on entity-bearing sentences, so behaviour on entity-sparse text is untested.

Citation

See the code repository.