bert-medium-nli
Fine-tuned prajjwal1/bert-medium for natural language
inference (entailment / neutral / contradiction), intended for use as a zero-shot
text classification model via the entailment trick (hypothesis = "This text is
about {label}.").
Trained on Pankaj8922/nli-high-quality-balanced, a
combined and filtered subset of MNLI, SNLI, FEVER-NLI, and ANLI:
annotator-agreement filtered, deduplicated, teacher-confidence filtered,
hypothesis-only artifact filtered, and class-balanced.
Results
| Split | Accuracy | F1 (macro) | Precision (macro) | Recall (macro) |
|---|---|---|---|---|
| Validation | 0.8389 | 0.8389 | 0.8389 | 0.8389 |
| Test | 0.8373 | 0.8372 | 0.8372 | 0.8373 |
Training details
- Base model:
prajjwal1/bert-medium - Epochs: 3
- Batch size: 64 (train), 128 (eval)
- Learning rate: 5e-05
- Max sequence length: 256
Labels
- 0: entailment
- 1: neutral
- 2: contradiction
Intended use / limitations
This is a small (~41M parameter) model, so its ceiling on zero-shot performance against novel, unseen label sets is lower than larger NLI-tuned checkpoints (e.g. DeBERTa-v3-base or -large variants). Best suited for fast inference or resource-constrained settings rather than maximum accuracy.