Aplomb 1 Omni
Aplomb 1 Omni answers typed questions about text, JSON, images, video, and audio with calibrated probabilities. You send a state and a set of questions; every question comes back as a probability distribution with a confidence value, in one request, and no text is generated.
- Question types:
noul(yes or no),choice(one of 2 to 255 options),score(2 to 10 ordered levels), andtool(which function to call from a list of function tools, with distributions over itsenumandbooleanarguments). - Inputs: text, JSON objects and arrays, images, video, and audio (speech, sounds, and music). For text, images, and video only, Aplomb 1 scores higher on most benchmarks below.
- Independent answers: questions never influence each other.
Results
Measured on 2026-09-27 with the weights in this repository, served the way the hosted model is. Accuracy is in percent; for calibration, lower is better. Aplomb 1 Omni was not trained on any benchmark below unless it is marked (a), and inputs that also appear in its training data were removed from scoring for every system. Other models were run with their own released inference code.
Audio
| Benchmark | Aplomb 1 Omni |
|---|---|
| MMAU (test-mini) | 74.3 |
| ESC-50 | 81.6 |
| MMSU | 76.6 |
| VocalSound (a) | 92.7 |
| CREMA-D (a) | 79.8 |
Decision benchmarks (the Intern-Decision evaluation bundle)
| Benchmark | Aplomb 1 Omni | Aplomb 1 | Jev (c) | Kev-27B | Intern-Decision-4B |
|---|---|---|---|---|---|
| Jevbench Easy | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 |
| Jevbench Original | 98.6 | 97.2 | 98.6 | 100.0 | 100.0 |
| Jevbench Hard | 62.2 | 68.5 | 72.1 | 72.1 | 71.2 |
| Typed Decisions (a) | 81.0 | 81.6 | 73.3 | 74.9 | 80.9 |
| ToolACE (a) | 97.1 | 96.8 | 91.3 | 89.4 | 96.5 |
| AG News | 88.0 | 89.0 | 89.6 | 90.8 | 90.8 |
| WildJailbreak | 92.7 | 93.5 | 96.3 | 89.9 | 90.2 |
| Average | 88.5 | 89.5 | 88.7 | 88.1 | 89.9 |
Calibration (lower is better)
| Metric | Aplomb 1 Omni | Aplomb 1 | Kev-27B | Intern-Decision-4B |
|---|---|---|---|---|
| Calibration pilot, Brier | 0.129 | 0.062 | 0.070 | 0.181 |
| Calibration pilot, ECE | 0.136 | 0.055 | 0.062 | 0.208 |
| Jevbench Hard, Brier | 0.484 | 0.401 | 0.375 | 0.415 |
| Jevbench Hard, ECE | 0.108 | 0.054 | 0.127 | 0.183 |
Text classification ((k): Kev-27B was trained on this dataset or its source)
| Benchmark | Aplomb 1 Omni | Aplomb 1 | Kev-27B | Intern-Decision-4B |
|---|---|---|---|---|
| ANLI R3 | 60.0 | 61.2 | 66.2 | 54.2 |
| SST-2 (k) | 96.6 | 95.6 | 96.0 | 91.6 |
| AG News (k) | 85.4 | 88.8 | 91.4 | 89.4 |
| Yelp stars (k) | 60.6 | 58.4 | 68.0 | 63.8 |
| Emotion | 57.0 | 61.2 | 59.6 | 56.6 |
| TREC (k) | 90.2 | 86.4 | 94.8 | 87.4 |
| Banking77 (k) | 78.0 | 80.2 | 84.2 | not supported (77 options) |
| CLINC150 | 82.2 | 87.6 | 82.0 | not supported (151 options) |
| HelpSteer2 | 42.5 | 42.5 | 37.5 | 28.2 |
Images
| Benchmark | Aplomb 1 Omni | Aplomb 1 | Intern-Decision-4B |
|---|---|---|---|
| POPE | 89.7 | 89.5 | 89.4 |
| MMStar (first 500) | 67.2 | 70.0 | 65.2 |
| MME (first 500) | 87.6 | 89.2 | 80.8 |
| HallusionBench (first 500) | 81.0 | 82.6 | 79.4 |
| AI2D (first 500) | 85.2 | 91.4 | 81.0 |
| BLINK | 65.9 | 69.3 | not run |
| MMMU (first 500) | 63.0 | 70.2 | 57.0 |
| Food-101 (first 500) | 91.0 | 89.8 | not supported (101 options) |
Video
| Benchmark | Aplomb 1 Omni | Aplomb 1 |
|---|---|---|
| TempCompass | 73.1 | 79.8 |
| Video-MME (short) | 74.9 | 83.6 |
| NExT-QA (multiple choice) | 83.8 | 85.6 |
| MVBench (b) | 69.5 | 73.5 |
(a) Another split of the same dataset was used in training. (c) Jev (jev-1.13.0) figures as published by Intern-Decision for the same items. (b) 5 of its 19 subtasks use CLEVRER, whose training split was used in training.
Quickstart
curl https://api.empiriolabs.ai/v1/decisions \
-H "Authorization: Bearer $EMPIRIOLABS_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "aplomb-1-omni",
"state": {
"call": {"type": "audio", "url": "https://example.com/support-call.wav"},
"account_tier": "business"
},
"questions": {
"wants_refund": {"type": "noul", "instructions": "Does the caller ask for a refund?"},
"tone": {"type": "score", "instructions": "How upset does the caller sound?",
"criteria": ["Calm", "Annoyed", "Angry"]}
}
}'
Every answer comes back with its probabilities and a confidence value. The full request and
response schema, media input, limits, and pricing are in the
Decisions API guide and on the
model page.
Run locally
pip install -U "transformers>=5.17" torch accelerate torchvision torchcodec
python run_aplomb.py --model empiriolabsai/aplomb-1-omni --request request.json --debias
request.json is a Decisions API request body; --debias matches the hosted API. The weights are bf16
and need about 70 GB of accelerator memory.
Limits
- The state plus the longest question: up to 60,000 tokens.
- Media: up to 16 images, 8 audio clips (10 minutes each), and 4 videos per request.
- Aplomb 1 Omni does not generate text and does not fill free-text tool arguments; those are listed
under
open_arguments.
License
EmpirioLabs Model License 1.0. Research, education, evaluation, personal use, and internal
commercial use by organizations with annual revenue under US$1 million are free. Offering the model as a
hosted service, commercial use above that threshold, and distributing it in products sold to others need
a commercial license: write to support@empiriolabs.ai. Using the model or its outputs to distill or train
another model is not permitted. The base model is licensed under Apache 2.0; its license text and the
attribution notice are in LICENSE-APACHE-2.0 and NOTICE.