- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a Metric Scale Propagation Network (MSP-Net) aimed at addressing the key issue of scene scale distortion and loss during feature extraction and normalization in zero-shot depth completion tasks. The network primarily consists of two core modules: 1) Scale Identification Module (SIM), which predicts the reliability of each sparse depth point by fusing RGB and sparse depth features, and extracts global scale anchors and multi-level scale tokens; 2) Scale Propagation Module (SPM), which utilizes visual affinity and spatial distance to globally iterate and propagate reliable local sparse scale cues, generating a dense scale field. Ultimately, the network predicts residual depth in the normalized space and combines the propagated scale field to recover high-precision dense metric depth.
Critical strengths
- The SIM module proposed in this paper predicts pixel-wise reliability masks by fusing RGB and sparse features, enabling adaptive selection of reliable measurement points and solving the noise and unreliability issues in sparse depth.
- The SPM module proposed in this paper introduces an affinity matrix guided by RGB and a spatial distance penalty mechanism, achieving precise iterative propagation of scale information within visually homogeneous regions. It not only successfully solves the problem of global densification of sparse scales but also strictly prevents the "leakage" of scale information when it crosses object boundaries.
Critical weaknesses
- This article mentions converting multi-level scale tokens () into channel-level modulation parameters and injecting them into the encoder's features through "ScaleFiLM". However, the article does not provide a specific implementation plan, diagram, or mathematical definition.
- In the Scale Propagation Module (SPM), the number of iterations through the affinity matrix determines the computational complexity and memory usage of the algorithm. However, the article does not mention how the number of iterations is specifically set. The experimental details also lack information regarding the value of . It is recommended to supplement with ablation experiments on the choice of .
- In Table 1 and other tables, what do the superscripts K and N in OGNI-DC represent? It is recommended to provide relevant explanations.Regarding the limitations mentioned in the conclusion, what is the core reason why the introduction of Depth Anything V2 prior actually improves the performance when dealing with sparse patterns with extremely uneven physical measurement distributions, such as KITTI 64-line LiDAR?
Questions for authors
Regarding the limitations mentioned in the conclusion, what is the core reason why the introduction of Depth Anything V2 prior actually improves the performance when dealing with sparse patterns with extremely uneven physical measurement distributions, such as KITTI 64-line LiDAR?