DziriBERT Sentiment
DziriBERT is the first Transformer-based Language Model that has been pre-trained specifically for the Algerian Dialect. It handles Algerian text contents written using both Arabic and Latin characters. This is a fine-tuned version that is ready to use for sentiment classification.
For more information, please visit our paper: https://arxiv.org/pdf/2109.12346.pdf.
How to use
from transformers import BertTokenizer, BertForSequenceClassification
tokenizer = BertTokenizer.from_pretrained("alger-ia/dziribert_sentiment")
model = BertForSequenceClassification.from_pretrained("alger-ia/dziribert_sentiment")
You can find a fine-tuning script in our Github repo: https://github.com/alger-ia/dziribert
How to cite
@article{dziribert,
title={DziriBERT: a Pre-trained Language Model for the Algerian Dialect},
author={Abdaoui, Amine and Berrimi, Mohamed and Oussalah, Mourad and Moussaoui, Abdelouahab},
journal={arXiv preprint arXiv:2109.12346},
year={2021}
}
Contact
Please contact amine.abdaoui.nlp@gmail.com for any question, feedback or request.