SurgBox-YOLOv8-x
YOLOv8-x detector for the seven Cholec80 surgical instruments, trained only on SurgBox pseudo-labels, with no human box used in training.
Paper: From Presence Labels to Bounding Boxes: Can Multimodal Large Language Models Scale Surgical Instrument Localization? (MICAD 2026) Code: github.com/M-Hamdy-M/SurgBox Dataset: M-Hamdy/SurgBox
Model
| Architecture | YOLOv8-x (Ultralytics), COCO-pretrained |
| Classes | Grasper, Bipolar, Hook, Scissors, Clipper, Irrigator, SpecimenBag |
| Training data | SurgBox train split (56 Cholec80 videos) |
| Training | 640 px, 20 epochs, default augmentation |
Results
COCO mAP on the 16 held-out test videos (39,354 frames) and on the expert-verified subset of the human reference (197 frames, 238 boxes), paper Table 2.
| mAP | AP50 | AP75 | F1 | |
|---|---|---|---|---|
| Test set | 0.713 | 0.869 | 0.782 | 90.6 |
| Expert-verified subset | 0.833 | 0.932 | 0.909 | 87.8 |
Usage
from huggingface_hub import hf_hub_download
from ultralytics import YOLO
model = YOLO(hf_hub_download("M-Hamdy/SurgBox-YOLOv8-x", "yolov8x_surgbox.pt"))
results = model.predict("frame.png", imgsz=640, conf=0.25)
for box in results[0].boxes:
print(model.names[int(box.cls)], box.xyxy[0].tolist(), float(box.conf))
The model was trained on Cholec80 frames (854×480). Cholec80 is not redistributed; request it from CAMMA.
License
Released for non-commercial use only, under CC BY-NC-SA 4.0, consistent with Cholec80. The model was trained with Ultralytics, whose license (AGPL-3.0) also applies to its use.
Citation
If you use this model, please cite our paper:
@inproceedings{hamdy2026surgbox,
title = {From Presence Labels to Bounding Boxes: Can Multimodal Large Language Models Scale Surgical Instrument Localization?},
author = {Hamdy, Mohamed and Abdel-Ghani, Muraam and Ahmed, Fatmaelzahraa and Nasar, Sifna and Ahmed, Mariam and Al-Jalham, Khalid and Al-Ali, Abdulaziz and Balakrishnan, Shidin},
booktitle = {Medical Imaging and Computer-Aided Diagnosis (MICAD)},
year = {2026}
}
Contact
Questions, issues and suggestions are welcome. Please open a discussion on this page or contact me.