Yap Phone Screenshot Classifier

Yap Phone Screenshot Classifier predicts two labels for one image:

1. screen: the phone-screen category.
2. safety: the content-safety category.

The model returns exactly two outputs: screen and safety.

The model is fine-tuned from timm/mobilenetv4_conv_medium.e250_r384_in12k.

What It Is For

This model is built for routing and filtering mobile screenshot workflows. It separates UI classification from safety classification so an application can answer both of these questions before running more expensive analysis:

• What kind of screen is this?
• Which safety category does this image belong to?

generic and other are real screen labels when included in the exported label map. generic means phone UI that is not one of the more specific trained screen classes. other means non-phone UI or images outside the phone-screenshot distribution.

Files

Outputs

The ONNX graph has two outputs in this exact order:

Inference uses argmax for both heads in this version.

Test Results

CPU Timing

Timing is measured with ONNX Runtime CPU execution on Apple M4 Max (16 logical cores). Total latency includes image load/preprocess, model inference, and label decoding.

Classification Labels

For the screen and safety label lists, see config.json.

Preprocessing

Use the preprocessing contract in preprocess.json.

1. Read the image.
2. Apply EXIF orientation.
3. Convert to RGB.
4. Resize so the longest side is 1024 pixels and keep the original aspect ratio.
5. Do not crop, stretch, square-pad before preprocessing, or horizontally flip.
6. Convert to float32 in [0, 1].
7. Normalize with the mean and standard deviation from preprocess.json.
8. Pad each normalized tensor to the batch maximum height and width, rounded up to a multiple of 32.

The exported model accepts dynamic batch, height, and width.

ONNX Inference

The helpers intentionally return only screen and safety.

Keep onnx/model.onnx.data beside onnx/model.onnx; ONNX Runtime loads the external tensor data when it opens the graph. By default the helpers load the FP32 model at onnx/model.onnx. Pass fp16 to load onnx/model.fp16.onnx.

Download

Download the exported model folder from Hugging Face:

from huggingface_hub import snapshot_download

model_dir = snapshot_download("yapwithai/phone-screen-classifier")

Python

Install the runtime dependencies:

python -m pip install numpy pillow onnxruntime

Import the helper from the exported model folder:

from inference.python import Classifier, classify

print(classify("example.png"))
print(classify("example.png", model_format="fp16"))

classifier = Classifier(model_dir)
print(classifier.classify_batch(["one.png", "two.png"]))

fp16_classifier = Classifier(model_dir, model_format="fp16")
print(fp16_classifier.classify_batch(["one.png", "two.png"]))

Or run it directly:

python inference/python.py example.png another.png --model-format fp16

TypeScript

Install the runtime dependencies:

bun add sharp onnxruntime-node

Import the helper from the exported model folder:

import { Classifier, classify } from './inference/typescript.ts';

console.log(await classify('example.png'));
console.log(await classify('example.png', modelDir, 'fp16'));

const classifier = await Classifier.create(modelDir);
console.log(await classifier.classifyBatch(['one.png', 'two.png']));

const fp16Classifier = await Classifier.create(modelDir, 'fp16');
console.log(await fp16Classifier.classifyBatch(['one.png', 'two.png']));

Or run it directly:

bun inference/typescript.ts example.png another.png --model-format fp16

Citation

If you use this model, please cite:

@misc{phone-screen-classifier,
  title={Yap Phone Screenshot Classifier},
  year={2026},
  publisher={Yap With AI},
  url={https://huggingface.co/yapwithai/phone-screen-classifier}
}