- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes AttenDiffCrafter, a diffusion framework for generating novel-view sequences from a single image and a specified camera trajectory. It uses a two-stream, multiscale Transformer architecture to process the clean source image and noisy target image. The proposed learnable query-key cross-attention combines image features, camera embeddings, and learned query embeddings to model source–target correspondences. Camera conditioning incorporates relative poses, Plücker embeddings, and temporal attention in the pose encoder. Experiments on Matterport3D and RealEstate10K report improvements in reconstruction metrics and short-term FVD.
Critical strengths
- Experiments demonstrate the paper achieves better performance on the task of novel view synthesis compared to baseline models.
- The paper is well-written and easy to understand.
Critical weaknesses
- Adopting transformer for novel view synthesis is very common and can not be seen as a contribution. The proposed method largely based on the structure of Pixel-Art and adds plucker ray to achieve camera control, this is not novel and all existing technique. So to me, the tech novelity and contribution of the paper is very limited.
- The paper emphasizes that the method does not require a pretrained video diffusion model, but the impact of pretraining is not sufficiently evaluated. I would recommend that the authors compare training from scratch with pretrained initialization under comparable settings, reporting both generation quality and training cost.
Questions for authors
N.A.