- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes SportWorldBench to study the trajectory-conditioned generation capability of video diffusion models on sports data. A pretrained video diffusion model (VDM) is fine-tuned on per-frame heatmap conditioning that denotes trajectories of balls. Then the model is tested on two questions: (1) given a correct trajectory and a shifted trajectory, does the output vary accordingly? (2) compared to a static video that repeats the last context frame, is the generated video conditioned on the correct trajectory more consistent with the ground truth video? The experiments are conducted on 2B and 14B variants of a video diffusion model. The authors provide their findings.
Critical strengths
None
Critical weaknesses
The primary weakness is the lack of critical information in paper presentation. The name of the VDM is not mentioned, and the details of adding additional conditions are not provided adequately. Therefore, it is hard to understand the experimental setup and the implications of the findings. Even if the name of the VDM is provided, the paper lacks a comprehensive comparison across different VDMs to show the applicability of the proposed benchmark.
The second weakness is that the designed test may not reflect the property we aim to study. In question 1, the authors aim to study the trajectory-following capability. However, the output conditioned on a shifted trajectory may not follow this trajectory because the shifted trajectory is wrong and cannot guide the object movement. The current test cannot distinguish the model's failure in trajectory following from the low quality of the shifted trajectory. In question 2, using per-frame similarity (LPIPS) to measure the trajectory quality may not be appropriate. A better way is to directly measure trajectory similarity between the generated video and the GT video.
Considering the lack of critical information and the issues in the designed test, I recommend rejecting the paper.
Questions for authors
Please resolve the concerns in weakness section.