GLiNER2 Mixed-Source Spanish Sentiment, Seed 42
This is the #1-ranked model from a three-seed mixed-source sentiment pilot. It reached mean macro-F1 0.671202 and mean accuracy 0.721218 across two evaluation sources. The model is a sentiment-only LoRA adaptation of fastino/gliner2-multi-v1; the PEFT adapter has been merged into the base weights.
Quick Start
from gliner2 import GLiNER2
repo_id = "erickdp/gliner2-multi-sentiment-mixed-c42"
extractor = GLiNER2.from_pretrained(repo_id, map_location="cpu")
sentiment = {
"positivo": "El comentario expresa emociones o actitudes favorables: admiración, cariño, apoyo, halagos, felicitaciones, entusiasmo, humor amistoso",
"negativo": "El comentario expresa emociones o actitudes desfavorables: crítica, insulto, burla, queja, rechazo, decepción, enojo, sarcasmo hostil",
"neutral": "El comentario no expresa carga emocional: preguntas sin emoción, información objetiva, menciones o etiquetas, anuncios, spam",
}
schema = extractor.create_schema().classification("sentimiento", sentiment)
result = extractor.extract("Me encanta este proyecto, excelente trabajo.", schema)
print(result)
The full GLiNER2 schema remains dynamically available, but only sentiment classification was supervised in this pilot. Validate other schema tasks independently before use.
Model Details
| Item | Value |
|---|---|
| Base model | fastino/gliner2-multi-v1 at c6296e25603e4d31f68ef8a9f4edb73421d1e45a |
| Framework | GLiNER2 1.3.2 |
| Pilot variant | C, 50/50 mixed source |
| Seed | 42 |
| Pilot rank | #1 by mean macro-F1 across both evaluation sources |
| Adaptation | Sentiment-only LoRA, merged into base |
| LoRA | r=16, alpha=32, dropout=0.05 |
| Sequence length | 384 |
| Effective batch size | 16 |
| Training limit | 5 epochs |
| Inference labels | positivo, negativo, neutral |
Training Data
The C training dataset contains exactly 2,500 rows:
- 1,250 Claude-generated short social comments.
- 1,250 human-labeled rows sampled from the training split of
erickdp/dataset_2026_04_22-v2. - Aggregate labels: 1,874 positive, 458 negative, and 168 neutral examples.
- Hugging Face source mapping:
0 = neutral,1 = positive,2 = negative.
The policy is polarity-first and intentionally imbalanced. Hugging Face validation and test splits were not used for training. Exact and normalized text matches were excluded to reduce leakage into evaluation sources. No training or evaluation text is included in this repository.
Evaluation
Two domains were evaluated: 500 Claude-labeled comments and 1,203 examples from the human-labeled Hugging Face test split. The reported means average the two source-level metrics, not their individual examples.
| Evaluation source | Accuracy | Macro-F1 | Balanced accuracy | Positive recall | Negative recall | Neutral recall |
|---|---|---|---|---|---|---|
| Claude-500 | 0.75000000 | 0.68561087 | 0.71679871 | 0.88461538 | 0.55813953 | 0.70764120 |
| HF human test (1,203) | 0.69243558 | 0.65679367 | 0.68553289 | 0.89035088 | 0.86033520 | 0.30591260 |
Intended Use
Use this model to pilot sentiment classification for Spanish social-media comments under a content-valence definition: favorable or beneficial content is positive, adverse or harmful content is negative, and content without clear emotional valence is neutral. Treat outputs as model predictions requiring domain validation, not as human annotations.
Limitations
- Half of the training rows are synthetic Claude examples.
- The deliberately polarized class distribution underrepresents neutral examples.
- Neutral recall is weak on the human Hugging Face test, especially relative to polar classes.
- The main focus is Spanish social-media comments, while the Hugging Face source includes varied content.
- Results span two domains with different labeling sources and should not be interpreted as a single-domain guarantee.
- The content-valence policy may differ from sentiment definitions based only on explicit author emotion.
- Synthetic labels and model predictions are not a human gold standard.
- Validate accuracy, calibration, fairness, and error costs on representative human-reviewed data before production use.
License
Apache License 2.0, inherited from the base model metadata.