- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes a training-free, human-aware accelerated Video DiT method. This method accelerates the text-to-video-to-motion conversion process by locating human/motion-related regions, performing most of the denoising computation only within these regions, and reusing predictions from outside these regions. The authors validated the method on the Wan2.2 and Helios datasets and evaluated it in terms of speed, reconstruction consistency, and motion quality.
Critical strengths
The main advantage of this paper lies in its highly task-specific problem setting, which allocates video generation computation based on the needs of downstream human motion reconstruction, rather than simply optimizing overall visual quality. Furthermore, the method requires no training, is relatively simple to implement, and can be combined with existing caching or sparse computation strategies. Experiments also cover different Video DiT methods and various motion reconstruction models.
Critical weaknesses
-
This method appears to be a combination of task-specific spatial cropping and reuse of outdated external models. What is its truly novel algorithm compared to existing spatially sparse video motion processing methods? Is the main contribution of this paper a new acceleration algorithm, or a new task-aware acceleration formula and evaluation protocol? What's more, the overall logic is somewhat disorganized, the diagrams are crudely drawn, and there is even a lack of subjective presentation of the results. The paragraph divisions are unclear, and the writing style seems rudimentary.
-
I disagree with the paper's assertion that "a unified, training-free, human motion-aware routing can be naturally transferred to different video motion processing methods." I suggest the authors add a more systematic analysis, such as the effectiveness of different pipeline schemes with the same fixed region of interest (ROI); and whether the same scheme can be used on different backbones.
Questions for authors
-
Please clearly explain the key algorithmic innovations of this paper compared to existing spatially sparse video diffusion acceleration methods.
-
What are the practical advantages of perceiving human eye domain selection? Under the same ROI size or token budget, does the proposed human eye perception method still have a significant advantage over fixed domain selection and other domain selection strategies? Distinguish the advantages of domain selection from those of general ROI routing.
-
How general is this method across various video DiT backbone networks?
-
How robust is this method in more complex human motion scenarios? For example, large-scale human motion, multi-person interaction, significant camera movement, and complex HOI scenarios pose significant challenges to current human/motion pipeline assumptions.