Multilingual Hate Speech Detector (XLM-RoBERTa)
Model Description
This is a fine-tuned XLM-RoBERTa model for multilingual hate speech detection, specifically trained on English and Serbian text. The model classifies text into 8 categories:
- Race: Racial discrimination and slurs
- Sexual Orientation: Homophobic content, LGBTQ+ discrimination
- Gender: Sexist content, misogyny, gender-based harassment
- Physical Appearance: Body shaming, lookism, appearance-based harassment
- Religion: Religious discrimination, islamophobia, antisemitism
- Class: Classist content, economic discrimination
- Disability: Ableist content, discrimination against disabled people
- Appropriate: Non-hateful, normal conversation
Languages Supported
- English: Comprehensive hate speech detection
- Serbian: Native Serbian language support (Cyrillic and Latin scripts)
Usage
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch
# Load model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("sadjava/multilingual-hate-speech-xlm-roberta")
model = AutoModelForSequenceClassification.from_pretrained("sadjava/multilingual-hate-speech-xlm-roberta")
# Example prediction
text = "Your text here"
inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True)
with torch.no_grad():
outputs = model(**inputs)
predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
# Categories
categories = ["Race", "Sexual Orientation", "Gender", "Physical Appearance",
"Religion", "Class", "Disability", "Appropriate"]
# Get predicted category
predicted_class = torch.argmax(predictions, dim=-1).item()
predicted_category = categories[predicted_class]
confidence = float(predictions[0][predicted_class])
print(f"Category: {predicted_category}")
print(f"Confidence: {confidence:.2%}")
Training Data
The model was fine-tuned on multilingual hate speech datasets including:
- English hate speech datasets
- Serbian hate speech datasets
- Augmented examples for better multilingual performance
Performance
- Accuracy: High-confidence predictions with detailed explanations
- Languages: English and Serbian with cross-lingual capabilities
- Categories: 8-class classification including appropriate content
Ethical Considerations
This model is designed for research and educational purposes. Results should be interpreted carefully and human judgment should always be applied for critical decisions. The system is designed to assist, not replace, human moderation.
Citation
If you use this model, please cite:
@misc{multilingual-hate-speech-xlm-roberta,
author = {sadjava},
title = {Multilingual Hate Speech Detector},
year = {2024},
publisher = {Hugging Face},
url = {https://huggingface.co/sadjava/multilingual-hate-speech-xlm-roberta}
}
Demo
Try the interactive demo: Multilingual Hate Speech Detector Space