- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes PRT-3D for RGB-T dual-modal 3D Gaussian Splatting reconstruction. Its main components include the Light Transmission Network (LTN), which leverages depth information from both RGB and thermal modalities to estimate atmospheric attenuation-related parameters and improve thermal reconstruction quality, and the Thermal Conduction Network (TCN), which utilizes edge information from both modalities to predict compensation residuals for thermal images, thereby enhancing boundary quality. The two modalities share Gaussian geometric parameters while maintaining separate opacity and appearance attributes.
Critical strengths
-
The paper addresses the challenges of large reconstruction errors in distant regions and blurred object boundaries in thermal reconstruction. The overall framework is clearly structured, and the proposed modules are well aligned with the identified problems.
-
Compared with ThermalGaussian, the proposed method achieves an average improvement of 3.72 dB in Thermal PSNR on scenes such as RGBT-Scenes, while largely preserving RGB reconstruction quality.
Critical weaknesses
- The paper overlooks several relevant methods, including MMOne (ICCV 2025), ThermoSplat (2026), and PhysIR-Splat (CVPR 2026), and does not sufficiently discuss the existing physics-based modeling designs in Thermal3D-GS (ECCV 2024). These omissions weaken the paper's novelty positioning and undermine the credibility of its state-of-the-art (SOTA) performance claims.
- LTN and TCN are essentially learning-based networks that leverage cross-modal depth and edge information, respectively. The current experiments are insufficient to disentangle whether the performance improvements stem from the proposed physical formulations or simply from increased network capacity and cross-modal feature fusion. Furthermore, ThermalGaussian has already considered the smoothing characteristics of thermal imaging, and the paper does not provide a sufficiently comprehensive discussion of prior work incorporating physical priors.
- RGB texture edges do not necessarily correspond to temperature boundaries, and vice versa. Although TCN employs a learnable compensation mechanism rather than enforcing strict edge alignment, the paper lacks an analysis of modality-specific edges and registration errors. Consequently, it remains unclear whether the proposed method can effectively prevent the erroneous transfer of edge information across modalities.
Questions for authors
- Could the authors provide comparisons with MMOne, ThermoSplat, and PhysIR-Splat under unified experimental settings, and further clarify the key differences between the proposed method and existing physics-based modeling approaches such as Thermal3D-GS?
- Could the authors include a parameter-matched conventional cross-modal fusion network as a baseline and independently evaluate the contributions of the exponential attenuation formulation in LTN and the edge information in TCN? Such experiments would help establish whether the performance gains genuinely arise from the proposed physics-inspired designs.
- In scenarios where RGB and thermal edges are inconsistent or slight registration errors are present, could TCN introduce spurious edges into the thermal reconstruction? Could the authors provide quantitative experiments or visual analyses to evaluate the method's robustness under these conditions?
6 comments
Reply to Reviewer cCWN (Part 2/4)
Q1: Comparisons with more baselines and Clarification of key differences (continued)
Q1.2: Clarify the key differences between the proposed method and existing physics-based modeling approaches such as Thermal3D-GS?
Our reply: Thanks for your guidance. We compare PRT-3D with the two physics-based methods, Thermal3D-GS and PhysIR-Splat. The key differences are as follows.
1. Multimodal interaction. This is the central difference. Thermal3D-GS is thermal-only. PhysIR-Splat reconstructs both modalities but keeps them decoupled: they merely share geometry, and its physical model is driven by the thermal modality alone. PRT-3D is the only physics-based method built on cross-modal interaction: both physical corrections are estimated jointly from the two modalities, with the choice of inputs derived from a MAP analysis (Sec. 4.4–4.5). The interaction is bidirectional: RGB evidence corrects the thermal reconstruction, and the gradients flowing back into the shared geometry also improve RGB (from 24.44 to 24.94 dB PSNR, Table A2).
2. Attenuation. Thermal3D-GS predicts the transmission distance with a network whose inputs are the Gaussian position and the capture time; since the camera position is not an input, this distance has no geometric link to the rendered viewpoint. PhysIR-Splat computes the distance geometrically for each Gaussian primitive but assumes a single attenuation coefficient for the entire scene, which cannot adapt to spatially varying conditions. In contrast, PRT-3D estimates the attenuation per pixel from the rendered surface depth, so it follows the actual viewing geometry and adapts spatially. Moreover, it is the only one that uses the depth of both modalities.
3. Conduction. PhysIR-Splat does not model the boundary blur caused by heat diffusion, and the conduction module of Thermal3D-GS relies on the thermal image alone, whose edges are weak and blurred. Our TCN uses the RGB edges as a cross-modal reference, which provides sharp and well-localized boundaries. As a result, PRT-3D reduces the cross-modal edge discrepancy by 18.3% on high-contrast scenes (Table A3), and the TCN improves not only thermal PSNR (+0.20 dB) but also RGB PSNR (+0.14 dB) through the shared geometry, which a thermal-only module cannot do.
In summary, PRT-3D differs from existing physics-based methods in that it lets the two modalities interact inside the physical model. This brings three advantages: the physical corrections are guided by cross-modal evidence rather than by the thermal modality alone; the attenuation follows the actual viewing geometry and adapts spatially; and the conduction term is anchored to the sharp RGB boundaries. As a result, the interaction benefits both modalities, improving thermal and RGB reconstruction at the same time.
Reply to Reviewer cCWN (Part 3/4)
Q2: Could the authors include a parameter-matched conventional cross-modal fusion network as a baseline and independently evaluate the contributions of the exponential attenuation formulation in LTN and the edge information in TCN?
Our reply: Thank you for the inspiring suggestions. We added all three comparisons. All variants share the backbone, the training schedule and the data split.
a. Parameter-matched cross-modal fusion network (PRT-3D w/o physics). It takes the rendered images and depth maps of both modalities () as inputs, has the same number of parameters as LTN and TCN combined (around 46.5 K), and adds its output to the rendered thermal image, without any physics-inspired structure.
b. Exponential attenuation formulation in the LTN (PRT-3D w/o exp). We keep the LTN inputs and capacity but replace by an unconstrained gain predicted by the network.
c. Edge information in the TCN (PRT-3D w/o edge). We keep the TCN capacity but feed it the rendered images and instead of their Laplacian edge maps.
| Method | Thermal PSNR↑ | RGB PSNR↑ |
|---|---|---|
| PRT-3D | 28.91 | 24.94 |
| PRT-3D w/o physics | 28.56 | 24.58 |
| PRT-3D w/o exp | 28.28 | 24.62 |
| PRT-3D w/o edge | 28.58 | 24.50 |
| Ref: PRT-3D w/o LTN | 28.60 | 24.58 |
| Ref: PRT-3D w/o TCN | 28.83 | 24.68 |
| Ref: PRT-3D w/o LTN and TCN | 28.40 | 24.44 |
The reference rows are from Tables A1 and A2 of the supplementary material. The results show that:
-
With the same inputs and number of parameters, the generic fusion network reaches 28.56 dB, which is 0.35 dB below PRT-3D. It recovers only 0.16 dB (31%) of the 0.51 dB gain brought by the two modules. Capacity and access to cross-modal information alone do not explain the main gain.
-
Removing the exponential formulation lowers thermal PSNR by 0.63 dB, and removing the edge inputs lowers it by 0.33 dB. In both cases the result is worse than removing the module altogether. The two modules are therefore effective because of their physics-inspired design, not merely because a network is added.
-
Each module also contributes individually (+0.43 dB for LTN, +0.20 dB for TCN), and their combination is best in both modalities.
These results indicate that the gains mainly arise from the physics-inspired designs rather than from added capacity or generic fusion.
Reply to Reviewer cCWN (Part 1/4)
Thanks a lot for the careful and constructive review. We are glad that you found our paper “clear and easy to follow”, the framework “clearly structured”, the proposed modules “well aligned with the identified problems”, and that our method “largely preserving RGB reconstruction quality”. Our replies to your three questions follow.
Q1: Comparisons with more baselines and Clarification of key differences.
Q1.1: Could the authors provide comparisons with MMOne, ThermoSplat, and PhysIR-Splat under unified experimental settings?
Our reply: We appreciate these great suggestions. We ran all three methods under the same setting as PRT-3D: the same train/test split, 30K iterations, the same resolution and the same evaluation protocol. MMOne and PhysIR-Splat are run with their official code. ThermoSplat has no public code, so we re-implemented it from its paper.
Table A. RGBT-Scenes.
Table B. Cross-dataset test on ThermoScenes (average over the 10 original ThermoNeRF scenes). All methods use the same configuration as on RGBT-Scenes, without per-dataset tuning.
Thermal reconstruction. PRT-3D achieves the best thermal PSNR on both datasets. On RGBT-Scenes, it exceeds PhysIR-Splat, MMOne and ThermoSplat by 3.19, 3.59 and 6.85 dB. On the cross-dataset test, it exceeds them by 4.61, 0.52 and 3.90 dB. We attribute this to the cross-modal interaction in our physics-inspired module: the other methods either do not model thermal physics (MMOne, ThermoSplat) or model it from the thermal modality alone (PhysIR-Splat), whereas PRT-3D supplies RGB depth and edge evidence exactly where the texture-poor thermal branch is unreliable.
RGB reconstruction. The RGB quality is close across methods: PRT-3D is within 0.38 dB of the best on RGBT-Scenes and within 0.55 dB on ThermoScenes. This small trade-off comes from the design focus. MMOne and PhysIR-Splat decouple the two modalities, so the RGB branch is optimized with little interference from the thermal one. PRT-3D instead couples the modalities through the physics modules, which benefits the information-poor thermal modality most and can slightly constrain RGB where the two modalities disagree.
In summary, under a unified setting and against the most recent methods, PRT-3D delivers the best thermal reconstruction on both datasets while keeping RGB quality comparable. This confirms that physics-inspired cross-modal interaction is an effective and complementary route to high-quality RGB-T reconstruction. We will add these comparisons and this discussion to the paper.