- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Thermal3R, a physics-guided feed-forward framework for thermal infrared 3D reconstruction based on VGGT. It introduces three key modules: Physics-Aware Radiometric Sensitivity Attention (PAM), Thermal Gradient Consistency (TGC), and Attenuation-Aware Correction (AAC). Additionally, the authors construct LargeThermal3D, a dataset comprising 90 thermal infrared scenes, with annotations including depth maps and camera parameters.
Critical strengths
-
Generalizable feed-forward 3D reconstruction from thermal infrared images is a research direction of significant value that remains relatively underexplored.
-
The construction of the dataset represents a meaningful contribution.
-
Thermal3R outperforms the fine-tuned VGGT baseline across multiple reported 3D reconstruction tasks.
Critical weaknesses
1. PAM introduces a temperature-weighting mechanism based on thermal radiometric sensitivity, but the relationship between its theoretical derivation and practical implementation remains unclear. The paper approximates the absolute radiometric sensitivity as , while Equation (3) derives a logarithmic radiometric sensitivity proportional to . However, the weighting term adopted in Equation (4) does not directly follow from the inverse of the absolute radiometric sensitivity. Although the authors empirically select this weighting formulation through the experiments in Appendix A.7, its physical justification remains insufficiently explained.
2. AAC derives a depth correction formula based on the Beer–Lambert law. However, this derivation implicitly assumes a deterministic relationship between the initial depth estimates and the radiative attenuation model, which has not been adequately justified for depth values directly predicted by a neural network. Furthermore, according to Equation (14), when the observed intensity is lower than the reference intensity and the attenuation coefficient is positive, the depth correction term becomes negative. This appears inconsistent with the explanation in the main text that additional attenuation should lead to an increase in the estimated depth.
3. TGC improves geometric reconstruction by enforcing consistency between the gradients of normalized thermal images and depth maps. However, its formulation closely resembles existing gradient-consistency regularization methods and does not explicitly model heat conduction or thermal diffusion processes. More importantly, Equation (10) not only encourages the spatial alignment of thermal and depth edges but also tends to enforce consistency in their gradient directions. Consequently, even when geometric boundaries are correctly localized, a substantial penalty may arise if the thermal intensity gradients and depth gradients point in opposite directions.
Questions for authors
-
Could the authors explicitly clarify whether the weighting in PAM corresponds to absolute radiometric sensitivity, logarithmic radiometric sensitivity, or an empirically designed approximation? If its purpose is to compensate for absolute radiometric sensitivity, could the authors further explain the quantitative relationship between this weighting term and Equation (2)?
-
Could the authors explain how the radiometrically inferred depth implicit in Equation (13) is related to the initial depth directly predicted by the neural network? Furthermore, when the observed radiance is lower than the reference radiance, Equation (14) yields a negative depth correction, which appears inconsistent with the physical explanation in the main text that additional attenuation should increase the estimated depth. Please clarify the definitions of the relevant variables and the direction of the depth correction.
-
For scenarios where thermal image gradients and ground-truth depth gradients point in opposite directions, or where thermal intensity edges exist without corresponding depth discontinuities, could the authors explain how Equation (10) avoids imposing incorrect constraints on geometrically accurate structures and provide corresponding quantitative validation?