- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Phy-DRILL, a physical attack against monocular depth estimation (MDE) based on the depth-reversal illusion. The central idea is to construct a physically convex object that appears visually concave: a truncated-pyramid structure protrudes toward the camera, while perspective-consistent textures printed on its surfaces resemble a corridor receding into the distance. Phy-DRILL jointly optimizes the geometry of the truncated pyramid and its surface texture using differentiable rendering. Its objective increases the predicted depth within the object region, encourages a pronounced protruding geometry, and uses a Stable Diffusion prior to preserve a corridor-like texture. The optimized texture is printed on paper and folded into the corresponding physical structure. Experiments use Depth Anything V2 as the white-box surrogate and evaluate transfer to five additional MDE models in digitally composited KITTI scenes and controlled near-field physical environments. The reported results show stronger attack performance than the evaluated 2D and 3D adversarial-patch baselines.
Critical strengths
-
Interesting geometry-aware attack idea. The paper presents an interesting physical attack that goes beyond conventional texture-only adversarial patches by treating physical geometry as an attack variable. Exploiting the depth-reversal illusion to make a convex object appear concave to MDE models is intuitive and provides a new perspective on the vulnerability of monocular depth cues.
-
Physical realization and broad model evaluation. The proposed object can be fabricated using printed paper and a simple folded structure. The paper evaluates both digital and physical attacks across six MDE models and includes ablations separating the effects of geometry and texture, providing initial evidence that the attack transfers beyond the white-box surrogate.
Critical weaknesses
-
The physical viewpoint robustness and practical deployability are not sufficiently demonstrated. The depth-reversal illusion depends on an alignment between the camera, the frustum geometry, and the perspective texture. Although the paper reports digital evaluations over a wide angular range, similar camera variations are already included in the optimization process, and the physical evaluation mainly considers frontal and ±30° views in a controlled near-field setting. It remains unclear whether the illusion persists under continuous ego-camera motion, unseen elevations and trajectories, realistic self-shadowing, or strongly oblique viewpoints where the object’s silhouette and occlusion reveal its convex geometry. Moreover, the reported relation implies a protrusion height of approximately 2 m at a 10 m observation distance, raising concerns about the practicality of the attack in realistic driving scenarios.
-
Evaluation metric may not establish depth reversal. The current evaluation metrics do not clearly distinguish depth reversal from ordinary depth-estimation error. In the physical experiments, the ground-truth depth is approximated using the camera-to-object placement distance. However, the adversarial object is a protruding frustum whose surface pixels have different physical depths. Treating the entire object region as having a single ground-truth depth may therefore count geometrically correct predictions as errors. This issue is important because the physical setup uses a frustum height of 0.1 m at a placement distance of 0.5 m, whereas (R_a) marks pixels as affected once their error exceeds only 10% of the reference depth. In addition, the absolute-error metric (E_d) does not distinguish the intended depth overestimation from underestimation or other prediction errors. The evaluation should use dense geometry-aware ground truth and report signed depth overestimation or an explicit depth-polarity reversal rate.
-
The evaluation is limited to frame-level depth errors and does not demonstrate a system-level safety impact. The digital experiments composite the adversarial object onto individual KITTI images, while the physical experiments evaluate isolated frames in controlled scenes. It remains unclear whether the attack remains temporally consistent as the vehicle approaches the object, or whether the induced depth error is sufficient to affect downstream obstacle detection, tracking, planning, and control. A closed-loop evaluation in CARLA or a comparable simulator, with a moving ego vehicle and an MDE-based perception and planning stack, would be necessary to substantiate the claimed autonomous-driving risk.
Questions for authors
See weaknesses.
6 comments
Response regarding to Weakness 2.
W2. How do the reference depth and evaluation metrics distinguish depth reversal from ordinary depth errors?
Thanks for raising this question. The reference for assessing depth reversal in our physical evaluation is the depth of the patch's base plane, and we chose it deliberately. The prediction must cross the base plane to count as reversal.
(1) A stricter criterion for reversal. The 2.5D patch physically protrudes toward the camera, so its protruding surface lies in front of the base plane. A depth estimation model can overestimate the surface depth and still place it in front of the base plane. The patch would then merely appear to protrude less. We count a reversal only when the predicted surface is placed behind the base plane. Moreover, once the prediction crosses the plane, the deviation measured from the base plane is smaller than the deviation measured from the true protruding surface. In this case, the base-plane reference gives a conservative measure of the signed depth overestimate.
(2) The base-plane reference is verified experimentally. To confirm that the base-plane depth is a reliable reference, we run the same depth estimation model on the original image and on a paired image in which the patch region is filled with white to remove the texture. In our validation experiment, the predicted depth of the white region agreed with the physically measured base-plane distance. Deviations () are computed against this paired prediction. Reversal is checked by whether the predicted patch depth goes beyond the measured base plane. We agree with the reviewer's point about . When 0.50 m is used as the surface reference, a correct prediction of 0.40 m at a protruding point gives a deviation of 0.10 m and exceeds the 0.05 m threshold.
(3) Physical evidence. To validate that our method achieves depth reversal, we conducted an additional physical experiment that measures the spatial profile of the predicted depth across the patch, from its protruding center to its edge.
Setup: A frontal-view photograph was captured in a real road scene, with the camera 2.0 m from the patch's base plane. Within the visible patch region, we defined five concentric rectangles: one central region plus four non-overlapping bands, so that we can examine how predicted depth changes from the center to the edge. Table R3.3 reports the geometric reference depth and the mean predicted depths of three metric MDE models in each region.
Geometric reference (Real Depth): depth increases from center to edge. Because the patch physically protrudes toward the camera, its geometric reference depth increases monotonically from Region 1 (center, 1.2 m) to Region 5 (outermost band, 2.0 m), by 0.80 m overall; the four inner regions all lie in front of the 2.00 m base plane. Note that a model which merely overestimates depth while still interpreting the surface as convex would preserve this ordering — closest at the center, farthest at the edge.
Predictions: depth decreases from center to edge, that is, the ordering is inverted. All models produce exactly the opposite profile. The mean prediction of DA-V2-Metric decreases monotonically from 30.25 m (center) to 11.80 m (edge), by 18.45 m overall; that of Metric3D decreases from 96.32 m to 24.69 m, by 71.63 m. Moreover, all mean predictions lie far behind the 2.00 m base plane.
Conclusion. The two observations jointly establish reversal rather than overestimation: (i) the center-to-edge ordering of the predicted depth is the mirror image of the geometric truth, and the protruding apex is perceived as the farthest part of the patch; and (ii) the patch as a whole is displaced far beyond its true location. This confirms that these models reverse the depth profile of the physically protruding patch in this example.
Table R3.3. Geometric reference depths and mean predicted depths across the five regions in the larger-scale physical experiment.
| Depth (m) | Region 1 (center) | Region 2 | Region 3 | Region 4 | Region 5 (outermost) |
|---|---|---|---|---|---|
| Geometric reference depth of the patch | 1.2 | 1.4 | 1.6 | 1.8 | 2.0 |
| DA-V2-Metric mean prediction | 30.25 | 22.72 | 19.11 | 14.96 | 11.80 |
| ZoeDepth mean prediction | 10.38 | 9.21 | 7.12 | 5.29 | 4.09 |
| Metric3D mean prediction | 96.32 | 65.91 | 47.78 | 30.71 | 24.69 |
Response regarding to Weakness 3.
W3. Does the depth deviation persist during approach, and what does this imply for downstream driving behavior?
Thanks for raising this question. Metric3D's depth deviation persisted during the recorded approach video and exceeded 40 m at all five plotted samples spanning the final 2.0 s.
Setup. We recorded a continuous 10-second video (300 frames at 30 fps) and evaluated Metric3D on every third frame, yielding 100 samples. For each sample, we computed within the patch region relative to the paired white-masked reference and reported it in meters.
(1) Temporal results. Across the 20 plotted points (samples 5–100, spanning 9.5 s), ranged from 1.81 to 46.33 m, with a median of 8.73 m. The deviation was below 10 m at all plotted points through sample 55 and above 15 m at all nine plotted points from samples 60–100, spanning 4.0 s. It peaked at 46.331 m at sample 95 and decreased slightly to 43.659 m at sample 100.
(2) CARLA evaluation. Our study focuses on monocular depth estimation, and our evaluation pipeline ends at the predicted depth maps. A closed-loop CARLA evaluation would require integrating those predictions into a driving stack, which is beyond the scope of this study.
Response regarding to Weakness 1.
W1. How does the method behave at longer observation distances and more oblique physical viewpoints?
Thanks for raising this concern. The larger patch still affected the depth predictions of all four evaluated models at 8.0 m, the farthest distance we tested. In the angle experiment, all evaluated models showed depth deviations at both −70° and +70°, with smaller deviations at these angles than in the frontal view.
Setup. The main physical comparison in the original submission used a 100mm-high patch observed at 0.5 m. In the additional experiment, we fabricated a larger patch from printed KT foam board and mounted it at the rear of a passenger car. The patch was 800 mm high, with base and top-face edge lengths of 722 mm and 123 mm, respectively. We captured photographs in a road scene and evaluated the MDE predictions offline. The distance experiment covered seven observation distances from 2.0 to 8.0 m. For the angle experiment, we fixed the observation distance at 4.0 m and captured one photograph every 10° from −70° to +70°. We report Ed, the mean absolute deviation from the paired reference prediction within the patch mask, on each model's output scale.
(1) Observation distance. All four models had smaller deviations at 8.0 m than at 2.0 m. DA-V2-Metric's Ed decreased steadily from 9.46 to 1.43. Metric3D showed a sharper drop from 43.66 at 2.0 m to 3.40 at 5.0 m, followed by fluctuations at longer distances and a deviation of 6.14 at 8.0 m. Table R3.1 shows how the effect changed with distance for each model.
(2) Viewing angle. The frontal view produced the largest deviation for three of the four models in Table R3.2. ZoeDepth peaked at −20°. For Metric3D, Ed was 5.44 at 0°, 0.58 at −70°, and 1.63 at +70°. Some intermediate views retained much of the frontal-view deviation. For example, Monodepth2's Ed was 7.28 at +20°, compared with 8.06 at 0°. The angle sweep covers oblique views in a road scene, and the approach sequence in W3 addresses persistence under camera motion.
(3) Patch height at longer distances. The reported 20.58% is the average height-to-distance ratio that maximized predicted depth in our simulation sweep. This is where the estimate of a roughly 2.0 m optimal height at a 10.0 m observation distance comes from. In the road experiment, the 800 mm-high patch was tested at 8.0 m, corresponding to a height-to-distance ratio of 10%. The results at that distance show that the patch can affect depth predictions at a smaller ratio than the simulated optimum.
Table R3.1. Ed at different observation distances.
Table R3.2. Ed at different viewing angles at 4.0 m.