- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents WEAVE – a method for image completion with arbitrary number of reference images in a feed-forward manner. The method extracts scene geometry using VGGT-Omega then warps the query and reference images. Using the warped and original images it utilizes MM-DiT arch to predict the complete in painted image.
Critical strengths
- The novelty of the paper is in the later part of the method, using the warped images to create the inpainting. This part is justified well by the ablation study and the U-Net adaptation, that shows the improvement comes from the warping and not from the model.
- The method shows strong results compared to the baseline with a large gap in PSNR and LPIPS. The example in figure 3 demonstrates it well and supports the claim of improvement with number of reference images.
Critical weaknesses
- Over claiming – “WEAVE: Warp Every Angle via 3D Geometry for Reference-Guided Image Completion” , “WEAVE estimates the geometry relating these views”. The method is based on VGGT-Omega which is a strong and legitimate backbone, but that is not something the method contribute. The paper should not claim as its own contribution the improvements of a frozen backbone, I found it misleading.
Questions for authors
In figure 2 there is a “text tokens” input to the MM-DiT, but it is not clear what is this input and how it is used. I only found a study about it in the appendix, but it is still not clear how it is applied. Can you please elaborate?
6 comments
Response to Reviewer MUgp (2/2)
Q1. Clarifying text tokens
Thank you for pointing out the need for a clearer explanation of the text tokens. To clarify, the text tokens represent a static task instruction passed to the backbone's frozen text encoder, and this same prompt is shared across all evaluations without any per-scene tuning. We have added this clarification to the main manuscript [Lines 207–209], rather than leaving it only in Appendix B.
These tokens are embeddings of the prompt: “Fill in the blacked-out region of the first image, keeping it faithful and consistent with the content, lighting, and details of the reference images” (Appendix B [Lines 813–815]). The embeddings are generated once by the backbone's frozen text encoder and injected through standard text-conditioning layers during denoising. While this instruction remains constant for all test scenes, scene-specific appearance and geometry are supplied by the Q-Warp, R-Warps, and raw reference images.
Dear Reviewer MUgp,
Thank you again for your review. We’re following up on the two clarifications in our rebuttal.
- Role of VGGT-Ω. We revised the abstract, introduction, related work, and method to explicitly credit frozen VGGT- for predicting camera poses and depth. WEAVE’s contribution is how it uses those predictions to guide completion, combining a merged target-view Q-Warp with separate R-Warps and raw references to retain evidence from individual views.
- Clarification on text tokens. Sec. 3.1 now explains that the backbone’s frozen text encoder embeds a single completion instruction for use during denoising. The text tokens tell the model what task to perform, while the warps and raw references provide the scene-specific evidence for the completion.
When you have a chance, we’d welcome your thoughts on whether these revisions clarify both points. Thank you for your time.
Response to Reviewer MUgp (1/2)
We thank the reviewer for recognizing the novelty of our conditioning design, the strong empirical gains, and the value of the ablations across both the MM-DiT and U-Net implementations.
W1. Clarifying role of geometry
We agree with the reviewer that the distinction between the pretrained geometry estimator and WEAVE's contributions should be explicit. Our core contribution lies in the multi-view conditioning framework for reference guided completion, rather than proposing a new geometry estimator. To prevent misunderstanding, we revised the wording throughout the manuscript to clarify that WEAVE relies on camera poses and depths predicted by a frozen VGGT-Ω model.
We updated this framing in the Abstract [Lines 32–33], Introduction [Lines 67–69], Related Work [Lines 111–113], and Method [Lines 126–128, 142]. For example, the revised text explicitly states that WEAVE uses geometry predicted by a frozen VGGT-Ω model. Our technical contribution focuses on how these geometric estimates are structured for the generative backbone. Specifically, we combine a merged, target-aligned Q-Warp with separate R-Warps and raw references, which allows the generator to leverage geometric alignment while retaining fine-grained information from individual views. The title of our paper, “Warp Every Angle via 3D Geometry,” thus refers directly to this multi-view conditioning strategy, particularly the use of R-Warps to preserve evidence across different viewpoints.