mmBERT-32K Factcheck Classifier (Merged)
This is the merged version of the mmBERT-32K factcheck classifier model, ready for direct inference without PEFT.
Model Details
- Base Model: llm-semantic-router/mmbert-32k-yarn
- Task: Text Classification
- Number of Labels: 2
- Context Length: 32,768 tokens
- Architecture: ModernBERT with YaRN RoPE scaling
Usage
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model = AutoModelForSequenceClassification.from_pretrained(
"llm-semantic-router/mmbert32k-factcheck-classifier-merged",
trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("llm-semantic-router/mmbert32k-factcheck-classifier-merged")
# Inference
inputs = tokenizer("Your text here", return_tensors="pt", truncation=True, max_length=32768)
outputs = model(**inputs)
Related Models
- LoRA Adapter: llm-semantic-router/mmbert32k-factcheck-classifier-lora
- Base Model: llm-semantic-router/mmbert-32k-yarn
License
Apache 2.0