- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces VisExpress, a benchmark for evaluating the visual expression and information communication quality of LLM-generated HTML pages, comprising 786 queries across 16 domains. The authors propose a multimodal evaluation framework with 13 metrics organized into two dimensions, Design Normativity and Presentation Effectiveness, to assess page quality, component selection, and information organization. Through experiments on 12 models and human evaluations, the authors find that strong visual design does not necessarily translate into effective information communication, with component selection and information organization remaining key challenges for current models. The paper provides a comprehensive and well-structured description of its dataset composition and evaluation framework.
Critical strengths
-
Practical Relevance. The paper addresses a meaningful research problem by moving beyond the visual aesthetics or code correctness of HTML pages to examine how effectively they organize and communicate information. This focus is more closely aligned with the practical needs of real-world generative UI applications.
-
Comprehensive Evaluation Framework. The authors introduce two evaluation dimensions, Design Normativity and Presentation Effectiveness, covering not only component quality and layout but also component necessity, information organization, and redundant content. The paper also provides detailed analyses and human evaluations to validate the proposed framework.
-
Dataset Scale and Diversity. The dataset covers a reasonably diverse range of queries, and the authors provide a detailed description of the dataset construction process, including human review. If publicly released, the dataset could serve as a valuable resource for future research.
Critical weaknesses
-
Limited Novelty of the Evaluation Framework. The paper primarily integrates existing evaluation metrics and relies heavily on VLM-based assessment. It does not introduce substantial methodological innovations that clearly distinguish it from existing approaches. Therefore, whether the proposed evaluation framework should be considered a novel contribution remains questionable.
-
Insufficient Fine-Grained Error Analysis and Visual Examples. Although the authors propose a comprehensive set of evaluation dimensions, the paper lacks detailed visual examples of specific error cases that would help illustrate the purpose and effectiveness of each metric. More qualitative analyses and comparisons of generated HTML pages would strengthen the justification for the proposed evaluation dimensions.
-
Insufficient Related Work Discussion and Comparisons. The paper does not adequately discuss or compare against relevant prior works, such as WiserUI-Bench, making it difficult to clearly establish its advantages over existing benchmarks. Additionally, more visual examples from the dataset would help readers better understand the benchmark's design, functionality, and evaluation capabilities.
Questions for authors
Same as weakness