Holo1.5: Foundational Models for Computer Use Agents

Model Description

Computer Use (CU) agents are AI systems that can interact with real applications—web, desktop, and mobile—on behalf of a user. They can navigate interfaces, manipulate elements, and answer questions about content, enabling powerful automation and productivity tools. CU agents are becoming increasingly important as they allow humans to delegate complex digital tasks safely and efficiently.

Our Holo1.5 series provides state-of-the-art foundational models for building such agents. Holo1.5 models excel at user interface (UI) localization and UI-based question answering (QA) across web, computer, and mobile environments, with strong performance on benchmarks including Screenspot-V2, Screenspot-Pro, GroundUI-Web, Showdown, and our newly introduced WebClick.

The Holo1.5 family comes in three model sizes to fit different deployment needs:

• 3B: inherits its license from Qwen
• 7B: fully open under Apache 2.0
• 72B: research-only license (non-commercial). For commercial use, please contact us.

These models are designed to provide reliable, accurate, and efficient foundations for next-generation CU agents, like Surfer-H, enabling them to manipulate real applications with unprecedented capability.

• Developed by: H Company
• Model type: VLM for Computer Use agents
• Fine-tuned from model: Qwen/Qwen2.5-VL-7B-Instruct
• Blog Post: https://www.hcompany.ai/blog/holo-1-5
• License: Apache 2.0 License

Training strategy

Our models are trained using high-quality proprietary data for UI understanding and action prediction, following a multi-stage training pipeline. The training dataset is a carefully curated mix of open-source datasets, large-scale synthetic data, and human-annotated samples.

Training proceeds in two stages: large-scale supervised fine-tuning, followed by online reinforcement learning (GRPO). The resulting Holo1.5 models are natively high-resolution (up to 3840 × 2160 pixels), capable of interpreting UIs and performing actions on large, complex screens with accuracy and efficiency.

Results

Holo1.5: SOTA UI Localization

UI Localization refers to an agent’s ability to find the exact positions of elements on a user interface (buttons, text boxes, images, etc.). This capability is essential for Computer Use (CU) agents because, to interact with an application—click a button, fill out a form, or read information—the agent must know where elements are located on the screen.

Our Holo1.5 models were evaluated on several standard UI localization benchmarks (Screenspot-V2, Screenspot-Pro, GroundUI-Web, Showdown, and our newly introduced WebClick) to measure how accurately they can predict these coordinates.

The results:

• Our 7B and 72B models outperform all previous models, achieving an average 4.5% improvement in localization accuracy.
• Our 3B model, while smaller, remains competitive with previous 7B models, demonstrating strong capabilities even with fewer resources.

These results establish a new Pareto frontier in open-source UI localization: the best trade-off yet between model size and localization accuracy, setting a new standard for CU agents.

Table 1: Localization benchmark scores for leading models. Bold values show state-of-the-art performance, scores in italic were obtained from previously reported sources and scores in non-italic were reproduced in-house

Holo1.5: SOTA Screen Content Understanding via Question Answering

While precise localization is essential for GUI agents, it is equally important for models to comprehend the structure and functionality of user interfaces to interact with them effectively. To evaluate these capabilities, we tested our Holo1.5 models on several GUI-focused question answering (QA) benchmarks, including ScreenQA Short, ScreenQA Complex, VisualWebBench, and WebSRC. These benchmarks measure the models’ ability to understand and reason about UIs, ensuring they can perform tasks accurately across diverse applications.

Table 2: Screen content QA benchmark scores for leading models. Bold values show state-of-the-art performance

Holo1.5 models show impressive capabilities in GUI QA tasks by improving on state-of-the-art models by 3.9%. This demonstrates strong visual perception capabilities in web and desktop environments, which is crucial for computer-use agents

Demo

Watch a demo of how to prompt the model in a computer use setting:

The demo is also live on our Hugging Face Space.

Next steps

Our goal is to build cost-efficient and reliable computer use agents. With the release of Holo1.5, we take an important step toward fostering trust and adoption of this technology.

This milestone is only the beginning—over the coming weeks, we will be unveiling new tools and agents powered by Holo models.

Stay tuned—we’re just getting started!

Citation

@misc{hai2025holo15modelfamily,
      title={Holo1.5 - Open Foundation Models for Computer Use Agents}, 
      author={H Company},
      year={2025},
      url={https://huggingface.co/collections/Hcompany/holo15-68c1a5736e8583a309d23d9b}, 
}