Karar-4B: small Turkish language model for local decisions
Karar-4B is one of the best open Turkish decision models at 4B parameters: a small Turkish language model for text classification, routing and decisions with probabilities. Karar-4B: 96.8% accuracy; Kev-4B: 87.1% on held-out Turkish decisions. The test set comes from the same data pipeline as the training data.
Try a decision in the browser, or run the GGUF build locally below.
Run locally
The Q4_K_M build used 3.03 GB RAM at a 4k context. The JevAlt server uses llama.cpp to read decision probabilities and load the matching calibration.
pip install "jevalt[serve,gguf] @ git+https://github.com/mertkayacs/jevalt" && jevalt serve --model mertkayacs/Karar-4B-GGUF --file Karar-4B-Q4_K_M.gguf
Ollama: ollama run mertkayacs/karar-4b (library page). It answers with the option letter; the JevAlt server adds the Jev API and calibrated probabilities.
Send a situation, question and options to the local server:
import requests
request = {
"state": "I was charged twice for my subscription. Please refund the duplicate.",
"questions": {
"team": {
"type": "choice",
"instructions": "Which team should handle this ticket?",
"criteria": {"billing": "payments, refunds", "technical": "bugs, outages"},
}
},
"reasoning": "off",
"abstain": False,
}
response = requests.post("http://127.0.0.1:8000/v1/systemone", json=request)
response.raise_for_status()
print(response.json())
Write the situation, question and options in Turkish. The API also supports yes/no questions, ordered scores and an unknown option with abstain: true. The card widget shows a recorded answer from the full-precision model.
This repository holds the full-precision weights. The JevAlt Transformers backend preserves the decision-token format and calibration:
pip install "jevalt[hf] @ git+https://github.com/mertkayacs/jevalt" && jevalt serve --backend hf --model mertkayacs/Karar-4B
See the local run guide for memory and client settings.
Karar-4B, metni sınıflandırmak ve seçenekler arasında karar vermek için geliştirilmiş küçük bir Türkçe dil modelidir. Ayrı tutulan Türkçe karar örneklerinde Karar-4B %96,8, Kev-4B %87,1 doğruluk elde etti. Eğitim ve test verisi aynı veri üretim sürecinden gelir. Q4_K_M sürümü yaklaşık 3 GB RAM ile kendi bilgisayarınızda çalışır.
Results and limits
On the same held-out Turkish decisions, Karar-4B's probability error (Brier score, lower is better) is 0.058, against 0.214 for Kev-4B. A separate live test on 4 October 2026 scored 113/130 for Karar-4B. Comparison files and live requests, including misses record both tests.
The models were fine-tuned with LoRA from Intern-Decision-4B, using JevAlt training data. Turkish is this model's focus.
- Refit calibration on your own data before using confidence thresholds. See JevOss.
- The model accepts text, with an 8k context. Long irrelevant text and date arithmetic remain weak spots.
- Planted instructions still change some answers. Keep authorization checks outside the model and review consequential decisions.
Downloads and project
GGUF files and measured agreement | Code and training | Karar-4B project page | Training and evaluation details | Benchmark page.
Apache-2.0. Cite the JevAlt repository for this release.
An Eschatia Labs project. Mert Kaya.