- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies depth estimation failures of feed-forward 3D foundation models on transparent objects. It identifies concentrated high-error predictions and an asymmetry between overestimation associated with background leakage and underestimation associated with flattened concave structures. The proposed adaptation framework combines Background-aware LoRA, which gates additional low-rank updates using geometric background affinity, with a Curvature-Informed Corrector (CIC), which predicts error directions from local geometry and routes correction through two branches. Evaluation covers three backbones (VGGT, π³, and DA3), ClearPose training and testing, and transfer to ClearGrasp and TRansPose. The paper reports substantial depth improvements and provides parameter-matched ablations, directional analyses, and failure cases.
Critical strengths
-
Substantial empirical improvement with a small adaptation budget. On ClearPose, the VGGT-based method reduces RMSE from 75.8 mm for LoRA r16 to 40.6 mm while using approximately 5.9M trainable parameters (Table 1). Evaluation across three backbones and two additional datasets broadens the evidence, despite some transfer failures. The magnitude of the in-domain improvement makes the approach potentially useful for transparent-object perception.
-
A useful failure analysis supported by targeted evidence for background-aware adaptation. The paper connects error direction to distinct geometric cues and translates this observation into selective adaptation. At a matched parameter budget, BG-LoRA improves RMSE from 77.9 mm for LoRA r12 to 60.1 mm; removing leakage selection gives 76.5 mm (Tables 4 and 15). These controls provide meaningful evidence that background-aware selection contributes beyond additional parameters.
Critical weaknesses
-
Transfer gains lack a matched LoRA baseline. Table 3 compares the full method with zero-shot models, without ordinary LoRA trained on the same data. The additional cross-dataset benefit of the proposed modules over ordinary adaptation therefore remains unclear.
-
The specific contribution of directional routing is insufficiently validated. Routing reduces RMSE from 41.5 to 40.6 mm (Table 15), but the consistency of this gain across scenes and its benefit on the targeted overestimated and underestimated regions are not established. This limits the evidence for a central design choice.
Questions for authors
- Validation request — cross-dataset advantage. How does the full method compare with ordinary LoRA trained on the same ClearPose data and evaluated under the same transfer protocol? Results for VGGT on ClearGrasp and TRansPose would directly address this concern; the DA3/ClearGrasp comparison would also help explain the reported transfer limitation.
3 comments
These results strengthen the evidence for the paper’s contributions. I maintain my original recommendation of weak acceptance.
We are sincerely grateful for your thoughtful response and for your engagement throughout the discussion period. Should any concerns remain, we would greatly appreciate it if you could let us know, and we will make every effort to address them.
Response to Reviewer jEGc
We thank the reviewer for the careful reading and for identifying the two places where the evidence was thin. Both concerns are addressed with new experiments below.
Transfer with a matched LoRA baseline
We added LoRA r16, trained on the same ClearPose data, to each cell of Table 3 and evaluated it with the same harness and protocol as our method. LoRA r16 is the baseline of Table 1, and it is trained for each of the three backbones with the same recipe.
Table R1. Table 3 of the main manuscript with matched LoRA baselines. RMSE in mm, AbsRel, and δ1.01 in percent. ClearPose and TRansPose use windows of six views, per frame affine alignment on all valid pixels, the transparent region, and the frame mean. ClearGrasp uses single images under the SeeClear protocol with affine alignment in the native output space of the model, on 113 images. Bold marks the best value within each backbone.
LoRA r16 is matched to our method in trainable parameter budget, which makes it the appropriate reference for the additional gain of our modules. LoRA transfers partially on its own, and our modules add a further gain on top of it in most settings. The gain is smallest where the zero-shot error of the backbone is already low, as on DA3 with ClearGrasp, which leaves little for a correction learned on ClearPose to remove.
Consistency of the directional routing gain across scenes and its effect on the targeted regions
We retrained the corrector over four seeds for our method and for each control, keeping stage 1 fixed, and scored each configuration per scene and per error direction. The controls remove the sign split with matched parameters, shuffle the routing while keeping the fraction of pixels sent to each path, and remove the curvature features from the direction classifier.
Table R2. ClearPose test, VGGT. RMSE in mm, mean ± sample standard deviation over four seeds. Over and under denote the RMSE on overestimated and underestimated pixels under the protocol of Table 17 of the supplementary material.
Removing the split, shuffling the routing, or removing the curvature features each raise the underestimation error by a similar amount.