- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes C2R#, which uses paired image supervision to address the difficulty of obtaining paired videos for coarse-to-real video generation. The authors train DINO-R2C to convert real videos frame by frame into pseudo-coarse videos, then mitigate information leakage through RGB decoding and re-encoding.
Critical strengths
- The idea of constructing pseudo-paired videos based on DINO features is reasonable, and the RGB bottleneck is also designed to address the information differences between training and inference.
- The method is evaluated on three types of inputs: games, geometric scenes, and animations, and performs well on the DOVER and VEFX metrics.
Critical weaknesses
- The ablations of key design choices are insufficient. Only qualitative examples are provided for the RGB bottleneck, with no quantitative results; the camera augmentation ablation also does not demonstrate a positive effect on final video generation performance. The relevant text may need to be reorganized.
- In Table 2, both optical flow and camera trajectory alignment are worse than those of VACE 2.2, and the VLM realism score is also slightly lower than that of the original C2R. This is very strange and undermines the paper's conclusions.
- The games and geometric scenes mainly come from Roblox, while the animations are generated by Wan2.2. Only aggregate metrics are reported, with no domain-specific results, which is insufficient for validation.
Questions for authors
- Could the authors provide quantitative ablations of the RGB bottleneck and camera augmentation on the final performance of C2R#?
- How large is the domain gap between pseudo-coarse videos and actual coarse inputs?
- Can the method maintain its performance on videos from other game engines or manually created animations?