ZeroGUI-OSWorld-7B
Introduction
We propose ZeroGUI, a fully automated online reinforcement learning framework that enables GUI agents to train and adapt in interactive environments at zero human cost.
-
Automatic Task Generation: Automatically proposes diverse, executable GUI tasks.
-
Automatic Reward Estimation: Assigns binary task rewards based on trajectory screenshots and employs a voting mechanism to avoid hallucinated success.
-
Two-Stage Online RL: Combines training on generated tasks and test-time adaptation to continually improve agent's performance.
Results
Usage
Please refer to our Github Repo.
Citation
If you find this work helpful in your research, please consider citing:
@article{yang2025zerogui,
title={ZeroGUI: Automating Online GUI Learning at Zero Human Cost},
author={Yang, Chenyu and Shiqian, Su and Liu, Shi and Dong, Xuan and Yu, Yue and Su, Weijie and Wang, Xuehui and Liu, Zhaoyang and Zhu, Jinguo and Li, Hao and Wang, Wenhai and Qiao, Yu and Zhu, Xizhou and Dai, Jifeng},
journal={arXiv preprint arXiv:2505.23762},
year={2025}
}