- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates attribute conflicts problem in reference-conditioned video generation and proposes AttriForget, a training-free method. It first uses a vision-language model to distinguish subject attributes that should be preserved from those allowed to change. It then identifies attribute subspaces through Jacobian-based probing of attention responses, preserves directions associated with persistent attributes, and progressively suppresses reference features corresponding to evolving attributes along the video timeline. Experiments across 4 backbone models demonstrate improvements in overall scores and naturalness, with further support from ablation studies and human evaluations.
Critical strengths
-
The proposed method is well motivated, and the paper is generally clear and easy to follow. The authors formulate conflicts between reference images and text prompts in terms of which subject attributes should be preserved and which should change. They enable selective control by protecting persistent attribute subspaces and suppressing directions associated with evolving attributes. This design offers a useful approach to balancing subject preservation and textual controllability without updating the generative model’s parameters.
-
Extensive experiments show some improvement and the motivation of the method. For example, table 1 shows improvements in both overall scores and naturalness across all six model/subdomain combinations. The human evaluation results in Table 7 provide further supporting. And Figure 2 show the analysis of attribute conflict.
Critical weaknesses
-
The existing experiments do not yet fully establish the method’s effectiveness. Although the paper addresses customized video generation, I do not find supplementary video demonstrations available for review. Static frames alone in paper are insufficient to reliably assess the qualitative video results. Moreover, in Table 1, FaceSim decreases from 48.56 to 45.30 for Phantom-1.3B on Open Domain, while Motion Amplitude decreases from 33.42 to 23.50 for Phantom-14B. An improvement in the overall score therefore does not necessarily indicate simultaneous improvements in attribute preservation and control over attribute changes. These points require further clarification.
-
The discussion of some closely related work could be more detailed. Although the paper briefly discusses TPIGE [1], that work also introduces Prompt Aware Reference Image Enhancement to resolve conflicts with the text prompt. A more detailed discussion of the relationship and differences between that method and the AttriForget would help clarify the contribution. As I am not an expert in this specific area, my knowledge of the relevant work may be incomplete. My current recommendation is therefore a tentative weak accept, and I will give my final assessment after considering the other reviewers’ comments. [1]Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement. ACM MM 25.
Questions for authors
-
Please address the concerns raised in the Critical Weaknesses section.
-
Please provide video demonstrations or comparisons during the rebuttal, given that the task is customized video generation.
-
In the camera example in Fig. 11(b), why do the outputs differ despite the annotation “Evolving: No”? Were the same random seed and otherwise identical inference settings used for both methods?
2 comments
Dear Reviewer x8HC,
I hope this message finds you well. As the discussion period is nearing its end with less than two days remaining, I wanted to ensure we have addressed all your concerns satisfactorily. If there are any additional points or feedback you'd like us to consider, please let us know. Your insights are invaluable to us, and we’re eager to address any remaining issues to improve our work. Thank you for your time and effort in reviewing our paper.
We appreciate your valuable feedback and support of our work. We hope the following clarifications and additional results address your concerns. W = Critical Weaknesses, Q = Questions For Authors.
To Q1 & W1:
These metrics involve trade-offs: improving one metric may come at the expense of another, so overall performance cannot be judged by any single metric’s rise or fall. Reference copying, for example, can inflate FaceSim. Phantom-1.3B shows clear reference copying in Fig. 12 alongside low Motion Amplitude and NaturalScore, illustrating how restricted dynamics can yield misleadingly high similarity. For Phantom-14B, higher optical flow may reflect camera motion or abrupt visual changes, as in the shoe and cup examples in Fig. 5, rather than better subject motion. Thus, decreases in these two metrics alone do not establish poorer generation.
To account for these trade-offs, OpenS2V-Eval uses weighted joint evaluation: NaturalScore 24%, FaceSim and NexusScore 20% each, Aesthetics 16%, GmeScore 12%, Motion Smoothness 6%, and Motion Amplitude 2%, assigning low weights to motion-related scores susceptible to inflation.Crucially, the official GmeScore implementation computes image–text similarities between sampled frames and the full prompt, then averages them across frames. Reordering the same frames leaves the score unchanged, so it cannot fully assess whether attributes evolve correctly over time. Human-rated text alignment improves from 2.67 to 3.01 on VACE-1.3B and from 3.43 to 3.74 on Phantom-14B (Table 7). Evaluation should therefore combine multiple metrics, human judgments, and visual results for a comprehensive assessment.
To Q2 & W1:
We have provided the video of the case presented in the paper in this anonymous repository:https://anonymous.4open.science/r/AttriForget-58A4
To W2:
We have added a detailed discussion in the Related Work section, highlighted in orange in Lines 182–194 of the revised manuscript, to clarify the above connections and differences.
TPIGE attributes generation difficulties to semantic mismatches between reference images and text prompts. Through experiments that control the conflicting attributes, we further find that reference and textual guidance oppose each other when imposing opposite attribute requirements, and tend toward orthogonality after the conflicting description is removed. This provides direct experimental evidence for the attribute-level source of the conflict and reveals the problem of treating all reference attributes as persistently valid constraints.
Regarding the solution, TPIGE’s reference image enhancement module first generates a new reference image that matches the prompt, and then generates a video conditioned on that image. This intermediate generation step may alter identity information in the original reference, and its ablation study also reports a decrease in identity consistency after adding image enhancement. AttriForget operates directly on the original reference features, protects persistent attributes through subspace disentanglement, and progressively removes only the reference constraints on evolving attributes, thereby avoiding the additional risk of information loss introduced by image regeneration while accommodating both subject preservation and attribute evolution.
To Q3:
We thank the reviewer for the careful observation. The “Evolving: No” annotation in Fig. 11(b) was an oversight during figure preparation. This example actually contains evolving attributes, such as knob rotation, and AttriForget applies forgetting to the corresponding reference features during inference, resulting in different outputs. Both methods used the same random seed and otherwise identical inference settings. We have corrected this annotation in the revised manuscript.