- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Hist2Depth, a method that uses a global SPAD histogram to improve monocular depth estimation. It first calibrates the overall depth prediction, then uses the current depth estimates to query SPAD information and refine local depth with image features. Experiments on NYU-Depth-v2 and captured RGB–SPAD data show improvements across several monocular depth models.
Critical strengths
-
The method is well motivated. Global D2 uses the SPAD distribution to correct the overall depth prediction, while MS-GRU combines depth-based queries with image context for local refinement. The two stages make sense given that the SPAD measurement provides distance information but no explicit pixel correspondence.
-
The results are encouraging. Hist2Depth improves the RGB-only predictions across all six tested backbones. With the same AdaBins backbone, it also outperforms SSD and PhoMoNet. The transfer from synthetic training to captured RGB–SPAD measurements without fine-tuning is a useful result.
-
The ablation studies are fairly comprehensive. Table 3 covers alternative fusion methods, the two stages, calibration order, and the number of refinement steps. The photon-budget experiments and qualitative examples also help show how the method behaves.
Critical weaknesses
-
The method's applicability to open road scenes remains unclear. Most experiments use NYU-Depth-v2, with depths evaluated up to 10 m (Section 4.1). Although the captured RGB–SPAD results are useful, they do not establish how well the method would work in open driving scenes with a much wider depth range. Since autonomous driving is an important application of depth estimation, some discussion of the limitations and adaptations needed for this setting would be helpful.
-
The role of updating the query locations could be explained more clearly. Table 3 shows that MS-GRU and additional refinement steps help, but it is less clear how much the changing query locations contribute to those gains. Some explanation based on the existing results would be useful. This is a smaller concern, since the ablations already support the overall module.
Questions for authors
Please see the weaknesses above.