- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates training-free Prompt Reinjection (PR) for improving spatial-relation generation in text-to-image MMDiTs. It systematically analyzes the effects of repaired token count, layer span, injection weight, and injected feature content. The findings show that repairing a small subset of tokens can match full reinjection, while excessive injection degrades performance and effective repair is concentrated in early-to-middle layers. Based on these observations, the paper proposes Layer-Adaptive Sparse Prompt Reinjection (LASP), which combines dense early-layer repair with sparse late-layer repair to reduce injection cost and improve robustness. Experiments are primarily conducted on SD3-medium, with additional evaluations on FLUX.1-Schnell and T2I-CompBench spatial subsets.
Critical strengths
-
Systematic analysis of PR's effectiveness and limitations. The paper shows that sparse repair can match full reinjection, while padding repair and feature substitution offer little benefit. It also identifies performance degradation from excessive injection, providing a more detailed analysis of PR on spatial tasks.
-
A practical application of the findings. LASP achieves performance comparable to full PR with approximately 66% fewer repaired token-layer pairs. Although it offers no inference speedup or clear advantage over volume-matched alternatives, it demonstrates how the findings can guide repair design.
Critical weaknesses
-
Limited novelty over the original PR method. The original PR[1] already explored layer spans, injection weights, and degradation at higher weights, making the claim that these dimensions were unexplored inaccurate. The main novelty lies in finer-grained analyses of token sparsity, padding, and feature content. LASP shows no clear advantage over full PR or volume-matched alternatives, nor does it improve inference latency, limiting its methodological contribution.
-
Spatial relation gains are not clearly disentangled from object generation improvements. In the 8-token experiment, object detection improves from 78.9% to 88.7%, while conditional relation accuracy increases only from 37.9% to 40.4%. This suggests that much of the gain comes from better object generation. The main LASP result (40.1%) lacks a similar breakdown, and improvements are concentrated on above/below, with limited gains on left/right.
[1] Yao et al. (2026). Prompt Reinjection: Alleviating Prompt Forgetting in Multimodal Diffusion Transformers.
Questions for authors
-
Distinction from the original PR. The original PR paper (Yao et al., 2026) already investigates target-layer coverage (Table 4) and injection weights (Tables 10–11), including performance degradation at higher weights. Thus, the claim in Section 2.1 that these dimensions were previously unexplored appears inaccurate.
-
Duplicated author name in the citation context. The paper contains duplicated author citations, such as “Spingarn et al. Spingarn et al. (2026)” in Section 2.1. These should be corrected.
Thank you for the additional experiments. The matched reversed-schedule comparison addresses my second concern and supports the early-dense/late-sparse design at higher injection weights.
However, the practical advantage over a properly tuned full-PR baseline remains unclear. The preservation gains at matched weights are useful, but do not establish a better accuracy–preservation trade-off when each method is tuned independently. With no latency or memory savings, this concern remains material to my assessment. I therefore maintain my score.