- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a metric depth calibration model for frozen diffusion-baseed relative depth models. It first runs the frozen diffusion-baseed relative depth models for their intermediate features. Then, it predicts the scale and shift conditioned on foreground / midground / background textual descriptions. It is applied on 4 diffusion-based depth models and are trained on 3 datasets using Scene-Scale Anchor Alignment (SSAA) loss based on log-median depth and KL divergence.
Critical strengths
-
Using the intermediate feature is practical, the intermediate feature of frozen diffusion-baseed relative depth models already captures both RGB image fetures and depth features. So we can keep the calibration model light and small.
-
Table 6 shows consistently improved AbsRel and when more designs are applied.
-
Rich supplementary materials. Supplementary's table 7 compares local descriptions with repeating the global description; table 10 compares different grouping methods; and table 9 compared SSAA with other supervisions.
Critical weaknesses
-
The calibration method proposed here largely overlapped with TR2M. TR2M already uses additional text conditions for predicting the scale and shift factors that lift a relative depth to metric. In my opinion, the differences are: a. using the intermediate features of frozen diffusion-baseed relative depth models; b. grouping text with depth; and c. the SSAA loss. But the overall method is not that new. Although the experiments cleanly tell that those differences are benefitial, the performance gains of those new designs are modest. I think the paper needs to be re-framed around those differences rather than being framed as a broader method for text-based relative-to-metric depth calibration.
-
The improvement over TR2M is not consistent on all datasets used for evaluation. In main paper's table 3 and 4, the calibration method proposed in this paper is better on 5 datasets but is worse on 2. And more discussions about this is better added.
Questions for authors
Please see weaknesses.
3 comments
Dear Reviewer,
We sincerely apologize for disturbing you. Last week we provided point-by-point responses to both of your comments.
In particular, we have re-framed the contribution around the three specific differences you identified — native diffusion-feature reuse, depth-structured language fusion, and soft-anchor scene-scale supervision — and revised the abstract, introduction and conclusion to state explicitly that pixel-wise text-guided relative-to-metric calibration is shared with TR2M. For the non-uniform improvement across domains, we now report the complete per-dataset comparison (five datasets improved, three regressed, with the corresponding AbsRel changes) and have added a diagnostic on the complete test sets, 19,781 images, that decomposes the per-image log-depth error into an image-level scale term and a de-meaned structure term: the two DIODE subsets are scale-dominated, whereas DDAD is structure-dominated. We have narrowed the generalization claim accordingly, and the diagnostic is reported in Appendix D.10.
We would greatly appreciate your feedback on whether these responses adequately address your concerns, or whether any questions remain. As the discussion deadline is approaching, we would be grateful if you could let us know as early as possible, so that we have sufficient time to address any remaining point before the discussion period ends.
Thank you again for your valuable and constructive feedback, which has helped us frame the contribution more precisely and strengthen the empirical evidence.
Best regards,
The Authors
Follow-up on contribution clarification and cross-domain results
Dear Reviewer,
As the discussion period is nearing its close, we would appreciate your feedback on whether our rebuttal addresses your two main concerns.
Following your suggestion, we have narrowed the contribution to native diffusion-feature reuse, depth-structured language fusion, and SSAA, while explicitly acknowledging the pixel-wise text-guided calibration formulation shared with TR2M. We also acknowledge the non-uniform transfer results: improvements on five of the eight datasets and regressions on three. The additional scale/structure error analysis examines these regressions and supports a more qualified interpretation of the cross-domain results.
Could you please let us know whether this reframing and the additional analysis resolve your concerns, or whether any point still needs clarification? If your main concerns have been satisfactorily addressed, we would be grateful if you could reconsider your assessment and score in light of the revised claims and additional evidence.
Thank you again for your time and consideration.
1、Overlap with TR2M and contribution
We agree that the paper should focus on the specific differences you identified. We have revised the abstract, introduction, and conclusion accordingly, explicitly acknowledging that text-guided, pixel-wise relative-to-metric calibration is shared with TR2M. We do not claim the inverse-depth scale–shift operator as new. The revised contribution comprises three design choices:
2、Non-uniform improvement across domains
The improvements are not uniform. Across the eight zero-shot datasets in Tables 3 and 4, our method improves both reported metrics over TR2M on five datasets and underperforms on three. Specifically, AbsRel increases from 0.2955 to 0.3204 on DIODE Indoor (+8.43%), from 0.1128 to 0.1379 on DDAD (+22.25%), and from 0.5046 to 0.5854 on DIODE Outdoor (+16.01%). These regressions limit any claim of consistent superiority across domains.
Appendix D.10 now provides a diagnostic comparison of both models on the complete test sets, totaling 19,781 images, with identical masks, crops, and depth ranges. For each image, let e denote the pixel-wise log-depth error, b its mean over valid pixels, and r² its de-meaned variance. The mean squared log-depth error decomposes as mean(e²)=b²+r². We compare dataset means, with Δ defined as our result minus TR2M's. The two DIODE subsets show predominantly scale-related excess error: Δb² is +0.099 on DIODE Indoor and +0.658 on DIODE Outdoor, while Δr² is approximately zero. The DIODE gaps also reverse after test-GT-assisted per-image scale normalization in the offline diagnostic. This supports the importance of image-level scale mismatch in these comparisons. DDAD exhibits a different pattern: the excess error is mainly in the de-meaned residual (Δr²=+0.0065), whereas the scale component is comparable and slightly favors our model (Δb²≈0). Thus, a global scale explanation alone does not account for all three regressions. These diagnostics identify different error compositions, not the causal failure of a particular module. In particular, the residual term should not be equated with a failure of the depth backbone, and GT-assisted scale normalization does not replace the direct metric-depth results or imply improved deployment performance. We have therefore limited the generalization claim to domain-dependent improvements and expanded the discussion of the three underperforming domains. The aggregate ranking is presented alongside the per-dataset results, rather than as evidence of uniformly better transfer.