- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents HumanFX, an image-to-video framework for human-centric visual effects generation that aims to preserve identity, anatomical structure, and motion continuity while improving effect assignment and interactions in multi-person scenes. Built on Wan2.2, the framework comprises three main components: identity-preserving supervised fine-tuning with a dedicated facial reference branch; reinforcement learning with anatomical and motion rewards, combined with supervised regularization to retain expressive effect dynamics; and VLM-guided test-time optimization, which constructs a differentiable visual question-answering objective to optimize the initial noise for more accurate effect assignment and character reactions in multi-person scenes.
Critical strengths
- The chosen task is interesting and holds practical value. The overall system design is well-targeted, and as an applied project, it is quite comprehensive. Making the dataset and model open-source for the community would likely enhance its impact.
- The visualizations are impressive, and the model itself appears to be of high quality.
Critical weaknesses
- The proposed VLM-guided test-time optimization is highly similar to UniRect-CoT [1] in both its underlying idea and methodology. Both construct differentiable semantic objectives from intermediate visual predictions and backpropagate gradients to the generation latents to improve instruction following. As such, the proposed approach appears to be an application of existing energy-based editing techniques, with limited methodological novelty. 2.The paper reads more like a technical report, primarily combining existing techniques rather than introducing substantial methodological innovations. The identity injection mechanism follows the common in-context conditioning paradigm and closely resembles Stand-In [2]. Likewise, the human-centric reward design and optimization rely largely on existing detectors, motion metrics, and DiffusionNFT. [1] UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding, https://arxiv.org/abs/2604.13540 [2] Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generation, https://arxiv.org/abs/2508.07901v4
Questions for authors
- See Weakness
- (Optional; will not affect the score) I am curious about the task addressed in this paper: what kind of results could be achieved using Seedance2.5 or Wan 3.0?