- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
To address the challenge of assigning credit to intermediate edits from terminal rewards in multi-turn webpage refinement, the authors propose STEPWEB. The key component, trajectory-conserving step-level credit assignment, categorizes edits as Regression, Repair, or New Gain and redistributes credit across refinement turns. The method preserves the token-weighted mean advantage of the original trajectory before policy clipping, with the goal of providing more informative step-level supervision and improving final reconstruction quality while reducing edit regression.
Critical strengths
-
TC-SLC distinguishes among Regression, Repair, and New Gain, and redistributes credit based on existing scores and token counts. This avoids additional interactions and does not require a learned value model, making the approach relatively simple and lightweight.
-
Compared with Terminal RL, STEPWEB achieves higher final scores and lower edit regression rates while starting from comparable initial scores. The ablation studies further provide evidence for the contribution of the main components.
Critical weaknesses
-
The paper does not provide a systematic discussion of existing step-level credit assignment approaches. Although several related works are cited, the methodological differences between TC-SLC and these approaches remain unclear. More importantly, the experiments do not include comparisons with closely related methods, such as WebGen-Agent [1]. As a result, it is difficult to assess how much of the reported improvement comes specifically from TC-SLC rather than from other aspects of the overall framework. Comparisons with representative step-level methods would help better establish the paper's contribution.
-
The Avg score for STEPWEB in Table 1 appears to be inconsistent with the stated averaging procedure across the three viewports. Specifically, the mean of 45.2, 39.0, and 32.4 is approximately 38.9, whereas Table 1 reports 37.7. Appendix Table 8 reports another value, 39.9, without providing an explanation for the discrepancy. These inconsistencies make it difficult to verify the aggregate results and the reported relative improvements, and raise concerns about the reliability of the experimental reporting.
[1] Lu, Zimu, et al. "Webgen-agent: Enhancing interactive website generation with multi-level feedback and step-level reinforcement learning." ICLR 2026.
Questions for authors
-
Could the authors clarify how the Vision2Web Avg score for STEPWEB is calculated and explain the discrepancy between the values reported in Table 1 and Appendix Table 8? More generally, it would be helpful if the authors could carefully check the reported numerical results throughout the paper and ensure that the tables and text are fully consistent.
-
Could the authors clarify how TC-SLC differs from existing step-level credit assignment methods? In particular, comparisons with closely related approaches under the same backbone and evaluator would help isolate the contribution of TC-SLC and better demonstrate its advantage over existing methods.