WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code

Zhiyu Lin, Zhengda Zhou, Zhiyuan Zhao, Tianrui Wan, Yilun Ma +2 more
6/9/2025
cs.CL

No official code found. Best implementation: MAIL-Tele-AI/WebUIBench (5 stars, last commit 2025-06-10).

Abstract

With the rapid advancement of Generative AI technology, Multimodal Large Language Models(MLLMs) have the potential to act as AI software engineers capable of executing complex web application development. Considering that the model requires a confluence of multidimensional sub-capabilities to address the challenges of various development phases, constructing a multi-view evaluation framework is crucial for accurately guiding the enhancement of development efficiency. However, existing benchmarks usually fail to provide an assessment of sub-capabilities and focus solely on webpage generation outcomes. In this work, we draw inspiration from the principles of software engineering and further propose WebUIBench, a benchmark systematically designed to evaluate MLLMs in four key areas: WebUI Perception, HTML Programming,WebUI-HTML Understanding, and WebUI-to-Code. WebUIBench comprises 21K high-quality question-answer pairs derived from over 0.7K real-world websites. The extensive evaluation of 29 mainstream MLLMs uncovers the skill characteristics and various weakness that models encountered during the development process.

View on arXivView PDF

Code Implementations(1)

MAIL-Tele-AI/WebUIBenchCommunity100%

Official implementation of **WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code (ACL 2025)**

51May 16, 20251 years ago

Similar Papers

VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?

86% match1 repo682024

WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation

85% match2025

Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

85% match1 repo1032026

Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering

84% match2024

MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistants

83% match2026

WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models

83% match1 repo1.1k2024

Cite this paper

@article{lin2025webuibench,
  title  = {WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code},
  author = {Zhiyu Lin and Zhengda Zhou and Zhiyuan Zhao and Tianrui Wan and Yilun Ma and Junyu Gao and Xuelong Li},
  year   = {2025},
  eprint = {2506.07818},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2506.07818v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2506.07818.svg)](https://codeofpaper.com/paper/2506.07818)

Discussion