W1. Occlusion changes and reprojection artifacts are not sufficiently controlled, which affects the interpretation of the central experiment.
Radial deformation changes occlusion relationships in the source views. Using each source view’s own RGB-D data, depth buffering, and visibility filtering is necessary and reasonable. However, single-layer RGB-D cannot recover surfaces that become newly visible after deformation but were not originally recorded. Background-favoring neighborhood filling only approximates these regions and may introduce texture propagation and boundary artifacts.
The code includes a control that preserves the original geometry while reproducing the hole pattern and applying hole filling. However, I could not find complete corresponding results for all three evaluated models on the primary metrics in the provided materials. The supplementary package also lacks the rendered inputs and hole masks, making it difficult to inspect the severity of these artifacts directly. The visibility implementation requires clarification: do the coverage conditions for combined views ensure valid correspondences for every point–view pair included in the statistics, and does determining visibility from hole-filled depth affect the results?
These issues affect the interpretation that the measured responses are caused by geometric cue conflict. Simply excluding holes from the evaluation region may not be sufficient, because artifacts elsewhere in the input can still influence predictions for other regions and camera parameters.
W2. The restricted viewpoint geometry weakens the experiment’s ability to distinguish competing explanations and limits the interpretation of the observed responses.
The evaluation uses only synthetic driving data, primarily involving forward motion with broadly aligned camera orientations. This is directly relevant to the central experiment: a radial deformation centered on the reference camera may be more readily approximated by changes in camera parameters when viewpoints are nearby and motion directions are restricted. The current results do not establish how strongly VGGT’s combination of limited depth-shape change and camera-side response depends on this viewpoint geometry.
Consequently, even if the joint outputs reproduce the target displacements well under the evaluated conditions, it remains unclear whether this reflects a more general output preference or an explanation that is particularly accessible under specific motion and parallax conditions. The triangulation control with ground-truth camera poses demonstrates that geometric information is recoverable, but it cannot by itself exclude this capacity for compensation when depth and cameras are estimated jointly.
Views captured along an orbit, larger relative viewing angles, and lateral motion would expose the same deformation from different directions and test whether camera adjustments can still substitute for changes in depth shape. Such evaluations could better distinguish competing explanations and establish whether the conclusions depend on forward-motion conditions. Comparisons should also control for, or stratify by, target displacement magnitude, valid coverage, and rendering artifacts, rather than merely increasing input difficulty.
Furthermore, the current results do not rule out structured out-of-distribution failure: the model may interpret unfamiliar scene deformations as familiar shapes observed under different camera parameters. Priors learned from training data are themselves a source of model bias, so behavior under this particular intervention should be distinguished from a generalizable geometric preference. The authors acknowledge that the architectural comparison is not causal, but the discussion of risks to practical systems still requires more direct external validation. The supplementary correlation check on inputs without scene deformation also does not establish the anticipated connection.
The evaluation covers only three models and omits other feed-forward geometric foundation models, such as π3X. However, compared with the viewpoint geometry and interpretation issues, I consider this a secondary limitation in coverage and would not treat the omission of any particular model as an independent reason for rejection.
Reply to Reviewer hjHW
Thank you for the review. The revision is rewritten for readability; the main changes are below.
Readability.
What is measured. The paper does not measure the error from perturbing depth.
Why it matters. These models return depth and cameras together, and downstream users take one or the other: a depth map, or a camera trajectory. When the views imply one shape and the main image another, it matters which of these goes wrong. The main finding:
So agreement with the images does not certify the 3D result.
On real images. Real scenes are not warped in practice. The warp is a controlled probe, in the same spirit as cue-conflict stimuli used to test image classifiers: real data cannot tell us which output should have moved, because real data do not let us set the conflict and know its size. Painting-style robustness tests measure how much accuracy drops. We ask a different question: which output changes, and whether that change is consistent with the images.
If any passage of the revision remains unclear, we will revise it.