- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper revisits this question that "source image condition + autoregressive generation of target prefix", the prediction correction brought by the target prefix is regarded as a controllable and partially reversible correction. Their model learns to retain only the parts that are useful for the real target in each target region/token, and withdraw the harmful or unnecessary parts, thereby improving the quality of autoregressive generation. They claimed that similar prefix effects can have different utilities depending on target alignment, while SPIRA better matches oracle decisions and achieves larger gains when more prefix correction can be safely retracted. Then they use a lightweight MLP gate to learn the withdrawal amount through predictive-action distillation (KL matching of the oracle distribution) during test stage.
Critical strengths
They observed that predictive effect alone cannot determine the appropriate source–prefix balance, or equivalently how much of each prefix correction to retain. They claimed the reason is that the disalignment of the predictive effect and the target utility. They try to solve this phenomenon using eqs 4, 5 and 6.
Critical weaknesses
During the test, they use a lightweight MLP gate to predict the retraction. However, this paper do not clearly reveal the relation between the alignment and the learned boundary of gate.
Questions for authors
(1) Why they choose the MLP gate distilllation technique rather than others? Why are those features being input? What is the evidence? (2) This paper seems to be presenting as a speech draft, is it good?
2 comments
Response to Reviewer KM3r (Part 2/2)
Q2: Presentation.
We thank the reviewer for this comment. We would like to clarify that our question-style subheadings and highlighted boxes were intentionally designed for two reasons:
-
Readability and clarity: These elements help readers follow the paper's motivation, methodology, and key findings, rather than serving as a speech-style presentation.
-
Visual organization: Their typography, color scheme, and visual hierarchy were carefully designed to maintain a clean, professional academic presentation while improving the organization and accessibility of the content.
We believe these design choices are compatible with scientific writing conventions.
Nevertheless, we understand the reviewer's concern and are open to refining the presentation to better align with conventional scientific writing, including reducing rhetorical questions or redundant takeaway boxes where appropriate. We would greatly appreciate any specific suggestions on sections that the reviewer finds overly presentation-oriented, and we would be happy to address them.
We are also grateful to the reviewer for the thoughtful comments and valuable suggestions. We hope these clarifications and existing experimental evidence adequately address the concerns. We warmly welcome any further questions, suggestions, or discussion to help us further strengthen our work.
Response to Reviewer KM3r (Part 1/2)
We are grateful to the reviewer for recognizing our central observation that predictive effect alone cannot determine the appropriate source-prefix balance, and for highlighting the importance of target alignment. Building on these observations, we clarify the relationship between target alignment and the learned gate, summarize the existing experimental evidence supporting our gate design, and address the presentation concerns.
Summary of Key Concerns and Main Responses
W1: Relationship between target alignment and the learned gate.
Thank you for highlighting the need to clarify this relationship. We clarify that target alignment determines the oracle's retraction boundary during training, while the learned gate approximates the oracle's behavior without accessing GT at inference. Specifically, Sec. 3.3, Eqs. (5)-(6) establish that target alignment and predictive effect jointly determine the maximal zero-regret retraction, as further illustrated in Sec. 4.4, Fig. 5. The gate then learns to approximate the resulting oracle predictive distribution using GT-free features.
Moreover, we clarify that we have provided two empirical analyses in our manuscript supporting this connection:
Oracle decision predictability (Appendix E.2, Fig. 10(a), page 29): The complete features outperform confidence- or effect-only features in predicting the three alignment-dependent oracle regimes.
Learned gate agreement (Sec. 4.5, Fig. 6(b), page 8): On identical generated-prefix states, SPIRA achieves a lower oracle-distribution KL divergence than the effect-only gate.
Overall, our analyses support the gate’s ability to approximate alignment-dependent oracle decisions from GT-free features, enabling adaptive source-prefix balancing without GT information at inference.
Q1: Justification of MLP gate.
Thank you for this thoughtful advice. Our current manuscript already provides experimental evidence and analyses supporting these design choices, which we clarify below.
Why a lightweight MLP? We choose a lightweight MLP because it can capture nonlinear interactions among source, correction, and endpoint features with minimal additional complexity. As detailed in Appendix B.3 (page 17), our gate uses a 128-dimensional hidden layer and introduces only 0.13M additional parameters (Appendix E.3, Table 23, page 31). Its effectiveness is further supported by the oracle-agreement analysis in Sec. 4.5, Fig. 6(b).
Why predictive-distribution distillation? We adopt distribution matching because our goal is to reproduce the oracle's predictions rather than its exact retraction scalar. The same scalar error can have different effects on the predicted distribution. In Sec. 4.3, Table 3 (page 6-7), SPIRA outperforms direct s∗ regression. Similarly, Appendix D.6, Table 15 (page 25) shows that SPIRA outperforms direct target-NLL optimization with the same gate inputs and architecture, supporting our choice of supervision.
Why these input features? We select these features because they provide complementary, GT-free information for retraction decisions, where uS captures source evidence, ur represents the prefix-induced correction, and (w,e) summarize differences between endpoint predictions (Appendix B.3, page 17). The ablations in Appendix D.6, Table 15 (page 25) indicate that removing or replacing these features consistently degrades performance, confirming their complementary contributions.
To sum up, our analyses support the lightweight gate design and show that the proposed features and distribution matching enable more effective retraction decisions than the evaluated alternatives.