🏷️ BalPOS v2 — Balochi Universal Part-of-Speech Tagger

State-of-the-Art Universal Dependencies POS Tagging for the Balochi Language

💎 Model Highlights & Architecture

BalPOS v2 is a transformer-based token-classification model fine-tuned from shahbakhsh/BalBERT specifically for Universal Dependencies (UD) Part-of-Speech tagging on the Balochi language (bal).

Developed by Shah Bakhsh, BalPOS v2 provides the foundational syntactic layer for the Balochi NLP research ecosystem.

Key Architectural Attributes

• Base Architecture: Pretrained Transformer (shahbakhsh/BalBERT)
• Task: Token Classification (Universal POS Tagging)
• Tagset: 16 Universal Dependencies (UPOS) tags
• Target Language: Balochi (bal)
• Validation Protocol: 5-Fold Cross-Validation over 85% data + 15% Untouched Final Hold-Out Test Set
• Deterministic Training: Fixed random seed (42), cuDNN deterministic execution enabled

🎯 Benchmark Performance (Final Hold-Out Test)

The evaluation results below reflect performance on the 15% final hold-out test set, which was never seen during hyperparameter optimization or fold selection:

⚙️ Hyperparameters & Model Selection

Model selection was performed via 5-fold cross-validation over the development split following randomized search hyperparameter optimization:

{
  "learning_rate": 1e-05,
  "batch_size": 8,
  "epochs": 15,
  "weight_decay": 0.01,
  "warmup_ratio": 0.05,
  "gradient_accumulation_steps": 1,
  "seed": 42,
  "best_fold": "Fold 5"
}

🚀 Usage & Quickstart

Option 1: High-Level pipeline

from transformers import pipeline

# Load BalPOS v2 pipeline from Hugging Face
tagger = pipeline(
    task="token-classification",
    model="shahbakhsh/BalPOS",
    aggregation_strategy="simple"
)

# Tag Balochi sentence
text = "وتی فلسفہ"
results = tagger(text)

for entity in results:
    print(f"Token: {entity['word']:<15} | Tag: {entity['entity_group']:<8} | Score: {entity['score']:.4f}")

Option 2: Direct PyTorch / Transformers API

import torch
from transformers import AutoTokenizer, AutoModelForTokenClassification

model_id = "shahbakhsh/BalPOS"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForTokenClassification.from_pretrained(model_id)
model.eval()

sentence = "وتی فلسفہ"
inputs = tokenizer(sentence, return_tensors="pt")

with torch.no_grad():
    logits = model(**inputs).logits

predictions = torch.argmax(logits, dim=-1)[0]
tokens = tokenizer.convert_ids_to_tokens(inputs["input_ids"][0])

for token, pred_id in zip(tokens, predictions):
    if token not in [tokenizer.cls_token, tokenizer.sep_token, tokenizer.pad_token]:
        tag = model.config.id2label[pred_id.item()]
        print(f"{token:<15} -> {tag}")

📊 Universal POS Tagset (16 Labels)

BalPOS v2 maps Balochi tokens to all 16 UPOS categories:

📂 Corpus & Dataset Information

• Corpus: Custom Balochi UD (CoNLL-U) Corpus
• Total Corpus Size: 774 sentences / 14,852 tokens
• Development Partition (85%): Used for 5-Fold Cross-Validation & HPO
• Test Partition (15%): Untouched hold-out test set for final reporting

⚠️ Limitations & Ethical Considerations

1. Single-Source Corpus: Annotations and vocabulary are inherited from the source CoNLL-U corpus.
2. Rare Tags Variance: Infrequent tags (such as INTJ or X) have higher variance in per-class evaluation.
3. Dialectal Scope: Evaluated primarily on standard orthographic conventions present in the training set.

🗺️ Balochi NLP Ecosystem Roadmap

BalPOS v2 is part of an ongoing open-source initiative for Balochi NLP led by Shah Bakhsh:

• 🟢 shahbakhsh/BalBERT — Pretrained Masked Language Model (Released)
• 🟢 shahbakhsh/BalPOS — Universal POS Tagger (Released)
• 🟡 BalNER — Named Entity Recognition for Balochi (In Development)
• 🟡 BalMorph — Morphological Feature Tagging (In Development)
• 🟡 BalParser — Universal Dependency Parser (In Development)

📜 Citation & Attribution

If you use BalPOS v2 or BalBERT, please cite this repository:

@misc{balpos_v2_2026,
  title        = {{BalPOS v2: Balochi Universal Part-of-Speech Tagger}},
  author       = {Shah Bakhsh},
  year         = {2026},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/shahbakhsh/BalPOS}},
  note         = {Fine-tuned from shahbakhsh/BalBERT on Balochi UD Corpus}
}

📄 License

Distributed under the Apache License 2.0.