- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes EpiPE, a method for camera-controlled video diffusion. Instead of using 4D homogeneous transformations or epipolar attention masking, the method applies 6D Plücker line transformations to queries and keys to incorporate epipolar coupling into learned attention scores. The method trains a camera adapter on top of a frozen Wan2.1 backbone and evaluates on PanShot and RealEstate10K, alongside a two-view depth estimation task with UniMatch.
Critical strengths
- Line transformation formulation: Using the Plücker line transformation law to bring epipolar coupling into per-token query and key transformations is sound and a neat idea compared to sampling along epipolar lines.
Critical weaknesses
- Very weak supplementary video results: The supplementary video presentation is one of the key components of a video generation submission, but here it is very bad. It has only 3 indoor scenes, the camera movement is tiny, the scene is visibly deforming while the camera is moving, and there is clear flickering. There is no supplementary website to compare side by side with previous works. There are also no ablation videos showing the effect of epipolar coupling, no videos for dynamics, and no diverse video results across scenes. This alone is enough to reject the paper.
- Weak results and marginal gains over UCPE: The quantitative gains over UCPE are very small on PanShot (translation error goes from 17.197 to 15.702), but FID actually gets worse from 62.55 to 65.01, and aesthetic quality drops on RealEstate10K. The results do not show that this formulation actually helps generate visually better videos.
- Missing comparisons and limited scenes: The video evaluation is only done on PanShot and RealEstate10K, which are just static indoor scenes. There are no results on scenes with dynamic objects, where the epipolar geometry assumption breaks down.
- Disjointed depth estimation experiment: Adding UniMatch depth estimation feels out of place and does not compensate for the weak video results.
Questions for authors
The method seems sound and I like the idea of using line transformations, but the visual results are not convincing and the evaluation is limited.
I would like authors to address following questions:
- Why does the supplementary only have 3 indoor scenes with tiny camera movement and clear deforming/flickering artifacts? Can you provide a supplementary website with side-by-side comparisons with previous works across diverse scenes and larger camera trajectories?
- How does the method handle dynamic objects? Does the approach fail or lead to distortions when dynamic objects violate the epipolar constraint?
- Why did the visual quality degrade compared to UCPE (worse FID on PanShot and worse aesthetic score on RealEstate10K)?
I am currently negative and it is rather unlikely that I will raise my score to an accept, but I am still happy to consider a rebuttal.