- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Reliable Few-Point Metric Grounding (RFMG), a lightweight framework for improving frozen monocular depth foundation models using extremely sparse metric observations. RFMG estimates observation-level reliability, performs reliability-weighted global scale calibration, and progressively enables local refinement according to the effective amount of reliable evidence. Experiments across three backbones and four datasets demonstrate improvements in metric depth accuracy and robustness to synthetic observation corruption.
Critical strengths
S1. Practical and meaningful problem. The paper addresses reliable metric grounding with only 1–16 observations, a relevant setting that complements conventional depth completion and modern monocular depth foundation models.
S2. Simple and modular design. Separating observation reliability from correction authority provides an intuitive framework for combining global calibration with conservative local refinement while keeping the backbone frozen.
S3. Broad experimental coverage. Evaluation across three backbones, four datasets, and multiple observation budgets demonstrates consistent improvements. On NYUv2, eight clean observations reduce UniDepthV2's AbsRel from 0.0766 to 0.0540, while maintaining 0.0608 under 80% corruption.
S4. Useful component analysis. The ablations suggest that reliability estimation and controlled local refinement both contribute to robustness, with only a small sacrifice in clean-observation accuracy compared with direct local grounding.
Critical weaknesses
W1. Incomplete evidence of superiority over existing methods. In Table 1, LDCM achieves better clean-observation accuracy at N=8 and N=16 (0.0488/0.0338 versus 0.0540/0.0401 for UniDepthV2+RFMG). Although RFMG performs better under heavy corruption, the baseline training and adaptation protocols are insufficiently clarified. Comparisons with simple robust scale estimators, such as median or Huber regression, are also missing.
W2. Robustness is evaluated primarily under matched synthetic corruption. Training and evaluation use the same depth-dependent Gaussian corruption model, with observations uniformly sampled from valid ground-truth pixels. This does not establish robustness to unseen noise distributions, systematic sensor bias, structured outliers, or realistic sparse sensing patterns.
W3. Observation reliability is not directly evaluated. Despite explicitly supervising the reliability scores, the paper reports no classification or calibration metrics. It remains unclear whether the reliability module can distinguish genuinely corrupted measurements from accurate measurements that strongly disagree with an erroneous monocular prior.
W4. Insufficient ablation of the correction-authority mechanism. The proposed gate depends on the sum of predicted reliability scores, but its specific design is not isolated experimentally. Comparisons against fixed gating, observation-count-based gating, and ungated reliability-aware refinement are missing. Furthermore, the effective-count formulation does not explicitly account for spatial redundancy among observations.
W5. Limited statistical and protocol transparency. Results lack variability estimates across independent observation-sampling and corruption seeds, which is particularly important in the few-point regime. The train/validation/test partitions for ETH3D, KITTI, and DIODE are also insufficiently specified despite dataset-specific refiner training.
Questions for authors
Q1. Regarding W1: Could the authors clarify whether the baselines use comparable training and adaptation protocols, and provide backbone-matched comparisons with simple robust scale estimators? This would help establish the benefit beyond corruption-aware training.
Q2. Regarding W2: How does RFMG perform under unseen corruption types, such as systematic bias, structured outliers, or real RGB-D/LiDAR noise? An out-of-distribution robustness evaluation would substantially strengthen the main claim.
Q3. Regarding W3: Could the authors report reliability prediction metrics (e.g., AUROC, AUPRC, and calibration error) and analyze clean observations exhibiting large disagreement with the monocular prior?
Q4. Regarding W4: Could the authors compare the proposed authority gate against fixed, observation-count-based, and ungated alternatives, including scenarios with clustered versus spatially distributed observations?
Q5. Regarding W5: Could the authors report mean and standard deviation across multiple observation-sampling and corruption seeds, and clarify the dataset splits used for in-domain training and evaluation?
The rebuttal deadline is approaching, and I would like to remind the authors to provide their response before it closes.
I believe this work addresses a worthwhile problem and am open to discussing the concerns raised in my review. The authors' clarifications may help me reconsider my assessment. However, without a response to these concerns, I would not have sufficient grounds to adjust my current rating.