- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SAGE-CREATE, a framework for improving generative UI quality through task specifications, execution-based verification, and reusable multimodal repair memory. The system follows a Reflect–Refine–Remember workflow to reuse verified repairs across tasks. The authors also introduce SAGE-BENCH, comprising 300 tasks, and SAGE-EVAL, which assesses specification fidelity, execution reliability, and experience quality. The framework is evaluated through ablation studies, cross-model transfer, an external benchmark, and expert assessments.
Critical strengths
-
The framework combines execution-based verification with reusable repair memory. Code patches, screenshots, and interaction traces provide supporting evidence for retrieving and validating previous repairs.
-
The paper includes ablation studies, comparisons with alternative strategies, cross-model transfer, external benchmark evaluation, and expert assessments, providing evidence for examining the contributions and applicability of the proposed approach.
Critical weaknesses
-
The approach relies heavily on accurate and complete task specifications. SAGE-BENCH provides structured contracts specifying components, states, views, and interactions, leaving its effectiveness under ambiguous or incomplete user requirements insufficiently evaluated. Moreover, repair acceptance relies on limited execution probes, which may miss functional regressions and propagate incorrect repair experiences across tasks. These issues raise concerns about reliability and generalization in realistic settings.
-
The methodological novelty and practical benefits remain insufficiently justified. SAGE-CREATE combines established techniques, including execution-based verification, program repair, experience retrieval, and memory management. The experiments do not sufficiently establish the necessity of the more complex memory mechanisms over simpler alternatives. Furthermore, the paper motivates the approach through reduced user corrections but does not directly measure human intervention. The efficiency comparison also lacks matched backbone models and output quality, making the practical cost advantage difficult to assess.
Questions for authors
-
How does SAGE-CREATE perform with only the original natural-language prompt, without a structured task contract? Can the authors evaluate requirement inference accuracy and the impact of incomplete specifications on task completion?
-
Can the authors quantify incorrect repair acceptance, functional regressions, and negative transfer when execution probes fail to cover important interactions?
-
Can the authors compare against simpler experience-retrieval and verified-repair approaches under matched generation and computation budgets to clarify the independent contributions of multimodal memory and curriculum management?
-
Can the authors directly measure user correction effort and compare overall costs under matched backbone models and output quality, including memory construction and maintenance overhead?