UrbanAnonymizer

UrbanAnonymizer detects faces and license plates in street-level imagery and masks them. A single two-class detector covers both object types. For video, an offline forward–backward tracker extends each mask across the frames in which the detector briefly loses the object, so a face that is detected in some frames is masked in all of them.

Highlights

• Accurate on external benchmarks. Face AP50 of 80.6 on UFDD and 56.5 on PP4AV, and plate AP50 of 82.5 on PP4AV, against 65.8, 25.7 and 62.1 for EgoBlur Gen2.
• Faces and plates in one model. D-FINE-X (HGNetv2-B5) at 1408 px input, trained on 119k images from five public datasets with class-verified partial labels.
• Temporally complete masking. Offline forward–backward tracking removes 93% of the frames in which a face drops out of the mask between detections on MOT17 and MOT20.
• Deployable. ONNX exports and a TensorRT 11 build path; 39 fps on 1080p video on one A100.

Explainer Video

Benchmarks

Every method is scored by the same evaluator (eval/evaluate_detector.py) on the same annotations: COCO AP and AP50, with each baseline run through its publisher's preprocessing at a 0.001 score floor (0.05 for CenterFace). UFDD and PP4AV are external benchmarks. The held-out and CRPD test sets are disjoint from training but come from sources that also contribute training images.

Faces.

License plates.

Recall at the recommended thresholds (IoU 0.5; masked area is the mean fraction of each image covered by masks with 20% padding).

Per-benchmark metric files, including threshold sweeps, size bins and mask coverage, are in results/metrics/; results/tables.md is generated from them.

Video: Forward–Backward Tracking

tracker/offline_tracker.py detects every frame at a low score floor, links detections into tracks forward and backward in time, and masks every frame of each confirmed track: its low-score detections, interpolated gaps, and a short extrapolation past its ends. Detections at the operating threshold are always masked, so the output never masks less than per-frame anonymization.

MOTChallenge provides pedestrian boxes but no face boxes, so we measure against the head region of each annotated pedestrian (visibility ≥ 0.5, height ≥ 100 px) on the MOT17 and MOT20 training sequences. A transient exposure is a frame in which a head is unmasked although it is masked within 1/3 s before and after.

--face-confirm 0.2 confirms tracks from stronger detections and masks less of the frame (5.5% instead of 7.2% on these sequences) while still removing 87% of transient exposures.

Available Checkpoints

Each checkpoint folder contains its resolved config.yml. Weights are EMA weights without optimizer state.

Quick Start

Install the dependencies:

pip install -r requirements.txt

Download the repository:

huggingface-cli download mehmetkeremturkcan/UrbanAnonymizer --local-dir UrbanAnonymizer
cd UrbanAnonymizer

Images

python scripts/anonymize.py input.jpg output.jpg \
    --config dfine_x_1408/config.yml --checkpoint dfine_x_1408/model.pth \
    --size 1408 --face-score 0.1 --plate-score 0.2

import sys
sys.path.insert(0, "scripts")
from PIL import Image
from anonymize import Detector, apply_masks

detector = Detector("dfine_x_1408/config.yml", "dfine_x_1408/model.pth", device="cuda:0", size=1408)
image = Image.open("input.jpg")
detections = [d for d in detector.predict(image, score_threshold=0.1)
              if d["score"] >= (0.1 if d["category_id"] == 0 else 0.2)]   # 0 = face, 1 = license plate
apply_masks(image, detections, mode="opaque", padding=0.2).save("output.jpg")

Video

Offline, with forward–backward tracking (recommended):

python tracker/offline_tracker.py input.mp4 output.mp4 \
    --config dfine_x_1408/config.yml --checkpoint dfine_x_1408/model.pth --size 1408

Streaming, one frame at a time, with FFmpeg encoding:

python scripts/anonymize.py input.mp4 output.mp4 \
    --config dfine_x_1408/config.yml --checkpoint dfine_x_1408/model.pth \
    --size 1408 --face-score 0.1 --plate-score 0.2 \
    --frame-batch-size 4 --preprocess-workers 4 --video-writer ffmpeg --crf 18

TensorRT

dfine_x_1408/tensorrt/model_trt11_fp16_b4.plan is a strongly typed TensorRT 11.3 engine (batch 1–4) built from model_amp_fp16.onnx and validated against PyTorch on an A100. Install the runtime into its own directory and run:

pip install --target trt11 -r requirements-tensorrt.txt
python scripts/anonymize_tensorrt.py input.mp4 output.mp4 \
    --engine dfine_x_1408/tensorrt/model_trt11_fp16_b4.plan \
    --engine-metadata dfine_x_1408/tensorrt/tensorrt_build_provenance.json --trt-runtime-dir trt11 \
    --config dfine_x_1408/config.yml --size 1408 --face-score 0.1 --plate-score 0.2 \
    --frame-batch-size 4 --preprocess-workers 4 --video-writer ffmpeg --crf 18

TensorRT engines are specific to the GPU architecture and TensorRT version. For other GPUs, rebuild with scripts/build_tensorrt_engine.py --onnx dfine_x_1408/model_amp_fp16.onnx --size 1408 --precision fp32 --strongly-typed and validate the engine before use.

Reproducing the Comparison

eval/ contains the complete pipeline behind the benchmark tables:

The held-out and CRPD test sets are part of the dataset repository; UFDD and PP4AV are obtained from their publishers and converted to the same COCO format in data/benchmarks/.

hf download mehmetkeremturkcan/UrbanAnonymizer-Dataset --repo-type dataset --local-dir data
for shard in data/data/test*.tar; do tar -xf "$shard" -C data; done
eval/download_baselines.sh

# predictions, one file per method and benchmark (shown for the held-out test set)
python eval/evaluate_detector.py --annotations data/annotations/test.json --image-root data \
    --config dfine_x_1408/config.yml --checkpoint dfine_x_1408/model.pth --size 1408 \
    --skip-metrics --output-prefix predictions/dfine_x_1408_heldout_s0of1
python eval/run_egoblur.py --annotations data/annotations/test.json --image-root data --generation gen2 \
    --min-score 0.001 --skip-metrics --output-prefix predictions/egoblur_gen2_heldout_s0of1
python eval/run_baseline.py --method centerface --annotations data/annotations/test.json --image-root data \
    --min-score 0.05 --output-prefix predictions/centerface_heldout_s0of1

# metrics and tables
python eval/compute_metrics.py --config eval/benchmarks.json --output-dir results/metrics
python eval/make_tables.py --metrics-dir results/metrics --output results/tables.md

All scripts accept --shard-index and --num-shards for parallel runs.

Dataset

The models are trained on UrbanAnonymizer-Dataset: 119,384 images and 347,427 face and plate boxes from Open Images, WIDER FACE, DARK FACE, CRPD and BirdsEye-RU, plus verified negative images, with per-image lists of the classes whose labels are complete.

Citation

@misc{turkcan2026urbananonymizer,
  title        = {UrbanAnonymizer: Face and License Plate Anonymization for Street-Level Images and Video},
  author       = {Turkcan, Mehmet Kerem},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/mehmetkeremturkcan/UrbanAnonymizer}}
}

License

The weights are released under CC BY-NC 4.0 because several training sources restrict commercial use. The bundled D-FINE and RT-DETR sources in external/ keep their Apache 2.0 licenses. Explainer footage: MOT17 and MOT20 (CC BY-NC-SA 3.0) and Wikimedia Commons clips under CC0, CC BY 3.0 and CC BY-SA 4.0, credited in the video.