- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies spatial-relation failures in text-to-video generation and proposes SPARC, a training-free inference framework. The authors motivate the method through analyses of asymmetric spatial-role representations in text embeddings and ambiguous relational grounding during early denoising.
SPARC parses the prompt into a fixed scene graph and introduces two components. Complementary Spatial Token Patching replaces reference-object token representations with representations obtained from inverse prompts that explicitly state the complementary spatial roles. Anchor-to-Graph Denoising selects an anchor object, performs a short anchor-focused initialization, and sequentially introduces relational conditioning during the first few denoising steps before continuing with the complete patched context. The text encoder and video generator remain frozen.
The method is evaluated on Wan 2.2 and Kandinsky using spatial prompts from T2V-CompBench and VBench, together with a constructed multi-relation setting. The paper reports improvements in spatial evaluation scores and provides diagnostic analyses, component ablations, and qualitative examples.
Critical strengths
-
The paper provides meaningful within-backbone evidence of improved spatial controllability. On Wan 2.2, the T2V-CompBench spatial score increases from 63.90 to 71.87 in Table 2, corresponding to a 12.5% relative improvement. In the multi-relation setting, Wan 2.2 improves across all four reported metrics. Results on Kandinsky provide additional evidence that the method can benefit more than one backbone. These comparisons support the practical usefulness of the proposed conditioning interventions.
-
The approach is practically appealing because it improves control without additional model training or user-provided spatial annotations. Both the text encoder and video generator remain frozen, and the method operates from a natural-language prompt without requiring user-specified boxes, masks, or trajectories. The 41-step baseline in Table 4 is also a useful control: it shows that simply adding one denoising step does not explain the reported gains. These properties make the method a potentially useful addition to compatible pretrained generators.
Critical weaknesses
-
The inability to explicitly model and control time-varying spatial relations substantially limits the paper’s contribution to video generation. SPARC constructs a fixed scene graph without explicitly assigning temporal validity to relation edges or representing transitions between different relations. A2G progressively introduces conditions during denoising, but this computational progression does not specify how relations should evolve along the generated video’s playback timeline. Consequently, the proposed mechanism does not address instructions such as “a person initially stands to the left of a car and then walks to its right.” Changes of this kind arise naturally in events involving crossing, overtaking, or movement around another object, making them an important part of spatial reasoning in video. Although the authors acknowledge this limitation, it remains a substantial restriction on the significance of the contribution: the method primarily improves generation under fixed relational constraints, while leaving the control of temporally evolving relations unaddressed. This also raises the question of what the method contributes specifically to video beyond spatial-conditioning improvements that could plausibly apply to image generation.
-
The architectural scope is limited, and transfer beyond explicit text cross-attention is insufficiently established. Both evaluated backbone families use explicit text-conditioning cross-attention, and the A2G procedure in Section 4.2 relies on sequential updates through this interface. The main-text description does not explain how the same procedure would operate in joint-attention or token-concatenation architectures, where selecting relation-specific text tokens can affect shared attention normalization and the evolution of both visual and textual states. CSTP appears less dependent on this particular structure because it modifies contextual text representations, and its requirements should be distinguished from those of A2G. The existing results demonstrate usefulness on the tested backbones, but provide limited evidence of compatibility across substantially different conditioning mechanisms. The paper should specify the architectural prerequisites and model-specific adaptations, rather than leaving the extent of transfer implicit.
Questions for authors
Q1. Scope of the video contribution: Given that SPARC uses a fixed scene graph and does not explicitly control time-varying spatial relations, what specific advance does it make in video spatial reasoning beyond improving fixed spatial configurations? Are the proposed failure mechanisms and interventions fundamentally specific to video, or are they general spatial-conditioning mechanisms evaluated on video backbones? Please clarify this distinction and the evidence supporting it. A suitable image-generation comparison or an evaluation of explicitly requested relation transitions would help establish the scope of the contribution.
Q2. Transfer to different conditioning mechanisms: Is A2G currently supported for joint-attention or token-concatenation transformers, or would these require a modified algorithm? If such transfer is supported, please explain the masking and state-update rules, including how visual and textual states are handled between relation-edge operations. If it is an untested extension, please state that boundary explicitly and distinguish it from the compatibility demonstrated by the current experiments.
Dear Reviewer,
Thank you for your review. The authors have submitted their rebuttal. Could you please take a moment to review their responses?
Thank you for your time and contribution!
Best,
AC