FinanceBERT
FinanceBERT is a transformer-based model specifically fine-tuned for sentiment analysis in the financial sector. It's designed to assess sentiments expressed in financial texts, aiding stakeholders in making data-driven financial decisions.
Model Description
FinanceBERT uses the BERT architecture, renowned for its deep contextual understanding. This model helps analyze sentiments in financial news articles, reports, and social media content, categorizing them into positive, negative, or neutral sentiments.
How to Use
To use FinanceBERT, you can load it with the Transformers library:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch
tokenizer = AutoTokenizer.from_pretrained('marcev/financebert')
model = AutoModelForSequenceClassification.from_pretrained('marcev/financebert')
def predict(text):
inputs = tokenizer(text, return_tensors="pt", padding=True, truncation=True)
outputs = model(**inputs)
predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
return predictions
text = "Your sample text here."
predict(text)
Examples
Try out these examples to see FinanceBert in action:
examples:
- text: "The company's financial performance exceeded expectations this quarter."
- text: "There are concerns that the recent scandal could lead to a decrease in shareholder trust."
Evaluation Results
FinanceBERT was evaluated on a held-out test set and achieved the following performance metrics:
- Accuracy: 92%
- F1-Score (Weighted): 92%
- Evaluation Loss: 0.320
Detailed Performance Metrics
Classification Report:
Negative Sentiment - class_index: 0
- precision: 0.84
- recall: 0.90
- f1_score: 0.87
- support: 29
Neutral Sentiment - class_index: 1
- precision: 0.94
- recall: 0.94
- f1_score: 0.94
- support: 199
Positive Setniment - class_index: 2
- precision: 0.90
- recall: 0.88
- f1_score: 0.89
- support: 83
Confusion Matrix:
| Predicted | Negative | Neutral | Positive |
|---|---|---|---|
| Actual Negative | 26 | 2 | 1 |
| Actual Neutral | 4 | 188 | 7 |
| Actual Positive | 1 | 9 | 73 |
Limitations
FinanceBERT has been rigorously trained and tested to ensure reliable performance across a variety of financial texts. However, there are several limitations to consider:
- Domain Specificity: Optimized for financial contexts, may not perform well on non-financial texts.
- Language Support: Currently supports English only.
- Data Bias: Reflects the bias inherent in its training data, which may not include diverse global financial perspectives.
- Interpretability: As a deep learning model, it does not offer easy interpretability of its decision-making process.
License
This model is released under the GNU General Public License v3.0 (GPL-3.0), requiring that modifications and derivatives remain open source under the same license.
Acknowledgements
FinanceBERT was developed using the Transformers library by Hugging Face, trained on a curated dataset of financial texts.