- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TidyUp, a lightweight framework for correcting geometric errors in layouts produced by design agents. It uses a reflection router to identify overlap and alignment violations and two specialized flow-matching correctors to adjust element positions without changing their content or other attributes. The framework also incorporates group-aware attention, edit-aware conditioning, and iterative correction with regression checks. Experiments on an internal design dataset and the public Crello benchmark show improvements over existing layout generation and self-correction baselines, particularly in alignment quality and inference efficiency.
Critical strengths
-
Practical and efficient layout correction. The paper addresses a meaningful problem in agentic design by separating geometric correction from expensive general-purpose reasoning. The proposed lightweight pipeline can repair layouts without rendering or regenerating content, making it potentially useful for multi-turn design workflows.
-
Promising results and reasonably comprehensive ablations. TidyUp improves the reported gated quality scores on both datasets, with particularly noticeable gains in alignment correction. The ablation study also helps explain the contributions of the reflection router, refinement masks, group-aware attention, and edit-aware conditioning.
Critical weaknesses
-
Inconsistencies in the evaluation metrics. The definition of the Gated Alignment Quality Score appears inconsistent across Appendix A.4.4 and Table 4. The text describes an average of Correction Rate and Preservation Rate, while the equations give different formulations. For example, the final configuration in Table 1 reports Correction Rate = 50.4 and Preservation Rate = 78.4, but the gated score is 63.6 rather than their average of 64.4. Similar discrepancies appear in the overlap scores. Since these metrics are central to the experimental comparisons, the calculation procedure needs to be clarified.
-
Limited validation of the do-no-harm guarantee and real-world generalization. The guarantee in Section 4.6 relies on the violation count predicted by the router, which may not reflect all actual geometric errors or unintended element movements. Furthermore, the main quantitative experiments use synthetically corrupted layouts, while real multi-turn agentic editing is mainly demonstrated through qualitative examples. More direct evidence is needed to establish the reliability of the complete pipeline in realistic settings.
Questions for authors
-
I noticed that the Gated Alignment Quality Score has different definitions in Appendix A.4.4 and Table 4. For example, the final model in Table 1 reports a Correction Rate of 50.4 and a Preservation Rate of 78.4, but the gated score is 63.6 rather than 64.4. Could the authors clarify which formula was actually used and how these scores were calculated?
-
The paper claims that TidyUp never returns a layout worse than its input, but the safeguard appears to rely on the router's predicted violation count. What happens if the router misses an error or if a correction introduces a new problem? It would be helpful to see how often such cases occur in practice.
-
Most of the quantitative results are based on synthetic layout defects. I wonder how well TidyUp performs on actual multi-turn agent-generated layouts. Could the authors provide a quantitative comparison on real editing outputs to support the claimed practical effectiveness?
-
Since the main task is geometric layout correction, I wonder how TidyUp compares with optimization-based methods such as LayoutRectifier. Would a simpler constrained optimization approach achieve similar correction and preservation results?
1. I noticed that the Gated Alignment Quality Score has ...
Thank you for identifying this inconsistency. Point 1 of our general response provides the exact formulas and explains this numerical example. The Gated Alignment Score averages Correction and Preservation over documents containing alignment defects, whereas the displayed Preservation column averages over all documents. Thus, averaging the two displayed columns does not reproduce the gated score. We have corrected the outdated appendix definitions and clarified the aggregation; reported values and rankings remain unchanged.
2. The paper claims that TidyUp never returns a layout worse than its input ...
We agree that Eq. 10 guarantees only a non-increasing router-estimated violation count, not preservation of true geometric constraints or design intent. We have revised the abstract and Section 4.6 accordingly; Point 2 of our general response details this clarification.
Missed errors. Figure 14(a) shows that the router classifies 19.9% of defective elements as unbroken, potentially leaving their defects unresolved. The routing masks guide rather than strictly constrain corrector movement, so unflagged elements may also be adjusted, occasionally repairing missed defects. This is not guaranteed, however additional Figure 16(b) shows the more than 50% of the missed but broken elements are indeed displaced towards fixing.
New problems. A proposed update is rejected if the router-estimated count increases. However, a new problem can pass the safeguard if the router misses it, or if other repairs offset it in the count. We therefore acknowledge this residual failure mode.
Figures 14(a–b), 16(a), Section A.6.5, quantify detection errors and unnecessary movement on valid designs. Point 3 of our general response and Table 5, Section A.7.1, report the complementary human evaluation, which identified one worsened design among 72 evaluated inputs. This is an end-to-end design-level regression rate, not a rate of new violations conditioned on accepted updates.
3. Most of the quantitative results are based on synthetic layout defects ...
Synthetic versus real defects. Figure 5 compares synthetic perturbations with real multi-turn agentic edits. Our induced edits more closely match the observed displacement frequency and magnitude, including the heavy tail, than the Gaussian perturbations used in prior work. Training covers a balanced range of defect severities. This supports the realism of the training distribution, but does not alone establish performance on natural errors.
We therefore added a blinded evaluation on 72 naturally defective designs produced by our pre-launch multi-turn workflow. Three independent judges with design expertise preferred TidyUp over VASCAR in 73.6%, 70.8%, and 75.0% of cases, respectively, and identified one design worsened by TidyUp. Point 3 of our general response and Table 5, Section A.7.1, provide the complete results.
4. I wonder how TidyUp compares with optimization-based methods such as LayoutRectifier...
We agree that constrained optimization is a relevant alternative and discuss it in Related Work. As noted in Point 4 of our general response, we could not locate a public LayoutRectifier implementation, and the available pseudocode lacked sufficient detail for a faithful reproduction and fair quantitative comparison.
Our choice of a learned repair pipeline reflects several practical differences in setting:
These differences motivate TidyUp’s application setting; they do not establish superiority over optimization or preclude extending an optimizer with similar capabilities. Without a matched comparison, we cannot determine whether a simpler constrained optimizer would achieve comparable correction and preservation. We acknowledge this evaluation gap and present TidyUp as a complementary, reference-free, position-only learned approach.