- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents WebViSE, a framework that learns reusable visual design skills from existing websites. These skills are organized into an evolving multi-parent DAG and used to improve website generation models through retrieval-augmented prompting or supervised fine-tuning. The paper evaluates the framework across seven models and three benchmarks.
Critical strengths
The paper addresses an interesting and practically relevant problem. Learning reusable design and interaction patterns from real websites seems like a promising way to improve LLM-based website generation.
The system is fairly comprehensive, and the evaluation across several models and benchmarks is a strength. In particular, the comparisons with generic and randomly selected skills help assess whether the extracted skills provide meaningful benefits.
The DAG evolution ablations also offer some evidence that refining the structure improves retrieval. The human evaluation and skill-augmented finetuning experiments further broaden the evaluation.
Critical weaknesses
My main concern is the novelty. Prior work, including SkillRouter and SkillDAG, has already explored skill extraction, structured retrieval, evolving skill libraries, and skill-based model improvement. Applying these ideas to visual website design is interesting, and the query induced DAG refinement is a useful extension. However, much of the framework appears to combine existing ideas rather than introduce a clearly distinct methodological contribution.
I find the empirical gains less convincing than the presentation suggests. Many improvements are in the range of 0–2 points, and some models perform worse with the proposed approach. For example, Kimi K3 drops by 1.60 points in aesthetics, while GLM-5.3 drops by 2.79 points in WebGen-Bench accuracy. Similarly, skill-augmented fine-tuning improves aesthetics and dynamic interaction but comes at the cost of some functionality metrics. These trade-offs deserve more attention in the discussion.
The human evaluation is useful, but each of the 350 comparisons is judged by only one evaluator making it impossible to assess inter-rater reliability. The retrieval-cost result also needs to be interpreted carefully. The reported 39.09% is relative to an expensive flat-LLM baseline and does not include the offline costs of extracting skills or evolving the DAG. Finally, while the released repository is valuable, it excludes the website-generation code and the generated training and evaluation corpora which limits full reproducibility.
Questions for authors
-
Can the authors provide repeated-run results or statistical significance tests to show whether the relatively small benchmark gains are reliable?
-
How much of the improvement comes from the evolving DAG itself? How does it compare with a simpler embedding based retriever using the same skill library and token budget?
-
Can the authors clarify the discrepancy between the DAG statistics reported in Table 12 and those in the publicly released DAG?
-
What is the total cost of building and maintaining the skill library, including skill extraction, query generation, and DAG evolution?
3 comments
The rebuttal addresses most my concerns, therefore, I would lean towards acceptance. Weak Accept
We are very encouraged by your response and sincerely appreciate your support. Thank you for taking the time to return to our paper and consider the rebuttal so carefully. We especially appreciate how clearly you explained your concerns in the initial review. This gave us a concrete basis for improving the paper, and it is rewarding to know that our responses have addressed most of those concerns. We have learned a great deal from this exchange. Thank you once more for the care and expertise you have shared with us throughout the review.
Dear Reviewer cezx,
As the discussion period is drawing to a close, we would like to kindly follow up on our rebuttal and ask whether our additional experiments and clarifications have addressed your concerns. We sincerely appreciate your time and thoughtful feedback. We would welcome the opportunity to clarify any points that remain unclear and provide any further information that would be helpful for your final assessment.
Thank you again for your consideration.
Sincerely,
The Authors