GrεBerta
The paper Exploring Language Models for Classical Philology is the first effort to systematically provide state-of-the-art language models for Classical Philology. GrεBerta is a RoBerta-base sized, monolingual, encoder-only variant. Further information can be found in our paper or in our GitHub repository.
Usage
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained('bowphs/GreBerta')
model = AutoModelForMaskedLM.from_pretrained('bowphs/GreBerta')
Please check out the awesome Hugging Face tutorials on how to fine-tune our models.
Evaluation Results
When fine-tuned on data from Universal Dependencies 2.10, GrεBerta achieves the following results on the Ancient Greek Perseus dataset:
| Task | XPoS | UPoS | UAS | LAS |
|---|---|---|---|---|
| 95.83 | 91.09 | 88.20 | 83.98 |
Contact
If you have any questions or problems, feel free to reach out.
Citation
@incollection{riemenschneiderfrank:2023,
address = "Toronto, Canada",
author = "Riemenschneider, Frederick and Frank, Anette",
booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23)",
note = "to appear",
pubType = "incollection",
publisher = "Association for Computational Linguistics",
title = "Exploring Large Language Models for Classical Philology",
url = "https://arxiv.org/abs/2305.13698",
year = "2023",
key = "riemenschneiderfrank:2023"
}