Model Description
This model is a fine-tuned version of the tohoku-nlp/bert-base-japanese-v3, specifically optimized for Named Entity Recognition (NER) tasks.
It is fine-tuned using a Japanese named entity extraction dataset derived from Wikipedia, which was developed and made publicly available by Stockmark Inc. (NER Wikipedia Dataset).
Intended Use
This model is intended for use in tasks that require the identification and categorization of named entities within Japanese text. It is suitable for various applications in natural language processing where understanding the specific names of people, organizations, locations, etc., is crucial.
How to Use
You can use this model for NER tasks with the following simple code snippet:
from transformers import AutoModelForTokenClassification, AutoTokenizer
import torch
model_name = "knosing/japanese_ner_model"
tokenizer = AutoTokenizer.from_pretrained("tohoku-nlp/bert-base-japanese-v3")
model = AutoModelForTokenClassification.from_pretrained(model_name)
Model Performance
The model has been evaluated on various entity types to assess its precision, recall, F1 score, and overall accuracy. Below is the detailed performance breakdown by entity type:
Overall Metrics
- Overall Precision: 0.8379
- Overall Recall: 0.8477
- Overall F1 Score: 0.8428
- Overall Accuracy: 0.9684
Performance by Entity Type
-
Other Organization Names (
の他の組織名):- Precision: 0.71875
- Recall: 0.69
- F1 Score: 0.7041
- Sample Count: 100
-
Event Names (
ベント名):- Precision: 0.85
- Recall: 0.8586
- F1 Score: 0.8543
- Sample Count: 99
-
Personal Names (
人名):- Precision: 0.8171
- Recall: 0.8664
- F1 Score: 0.8410
- Sample Count: 232
-
Generic Names (
名):- Precision: 0.8986
- Recall: 0.9376
- F1 Score: 0.9177
- Sample Count: 529
-
Product Names (
品名):- Precision: 0.6522
- Recall: 0.5906
- F1 Score: 0.6198
- Sample Count: 127
-
Government Organization Names (
治的組織名):- Precision: 0.9160
- Recall: 0.8276
- F1 Score: 0.8696
- Sample Count: 145
-
Facility Names (
設名):- Precision: 0.7905
- Recall: 0.8357
- F1 Score: 0.8125
- Sample Count: 140
Note
You might not able to use the model with huggingface Inference API. The intended use for the model is given in the following repository: KeshavSingh29/fa_ner_japanese If you have any questions, please feel free to contact me or raise an issue at the above repo.