- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents a two-stage framework for RGB-to-IR image translation. The first stage adopts a CycleGAN-style bidirectional unpaired translation scheme to learn cross-modal appearance priors, while the second stage retains the RGB-to-IR path and fine-tunes it using paired data. The paper also introduces the THIRAlign paired RGB–IR dataset and several training losses targeting thermal-source responses and RGB-texture leakage. Overall, the dataset appears to be an important contribution of the paper. On the method side, the framework mainly builds on an existing pretraining and fine-tuning paradigm, with its main additions being heuristic loss designs. There remains substantial room to strengthen the experimental validation, dataset documentation, and method presentation.
Critical strengths
Please refer to the Paper Summary Section
Critical weaknesses
1.The compact-source loss is based on a simple heuristic: it selects small bright regions in the target IR image using fixed rules and penalizes the model when these regions are predicted too dark. In the ablation table, the compact-source loss is removed together with another bright-region loss. Therefore, it is unclear how much improvement comes from the compact-source loss itself. As an additional comparison, the authors may consider using a conventional visual saliency map or local-contrast map to define the important thermal regions. This could help validate the advantage of the proposed compact-source mask.
2.THIRAlign appears to be one of the paper’s main contributions, yet its collection and alignment procedure are only briefly described. The appendix should provide detailed acquisition and calibration/alignment procedures, quantitative alignment errors, and comparisons to existing paired RGB–IR datasets. Figure 1 is not informative in its current form: any paired RGB–IR dataset can show corresponding RGB/IR examples. The paper should also report the number of independent scenes, sequences, capture durations and environmental conditions. 32k image pairs may contain substantial temporal redundancy if they originate from a small number of slowly changing scenes.
3.The mask is defined by regions with a strong RGB Sobel response but an IR response below a fixed quantile; this is not equivalent to the texture exists in RGB but absent in IR. It can also include valid but moderately strong thermal edges. The authors should provide sensitivity analyses for the Sobel quantile, loss weight, and mask coverage, together with qualitative examples of the selected regions.
4.In Figure 3, especially the M3FD and KAIST examples, the advantage over strong baselines is not visually clear. Moreover, the appendix provides additional quantitative ablations but no corresponding qualitative ablations.
Questions for authors
5.The first stage largely adopts a conventional CycleGAN-style bidirectional unpaired translation objective on a latent diffusion backbone, while the second-stage paired RGB-to-IR calibration appears to be the main technical component. The paper should better distinguish an effective pretraining recipe from a methodological contribution, reduce the emphasis on Stage 1, and compare against stronger alternative ways to exploit unpaired IR data.
6.As an additional comparison, it would be useful to evaluate direct Sobel/gradient supervision between generated and target IR images. This would help clarify whether the improvement comes specifically from the proposed RGB-aware masking strategy, rather than from introducing an additional edge-level constraint in general.
2 comments
I thank the authors for their response. Unfortunately, most of my concerns have not been adequately addressed. The additional ablation results only demonstrate the effectiveness of the combined losses, rather than the individual contribution of Lcc. Similarly, although the proposed leakage loss shows effectiveness in the new experiments, its physical justification remains unclear, and the choice of thresholds has not been sufficiently explained. Furthermore, my remaining questions have not been addressed. Therefore, I am inclined to maintain my original rating.
Loss Design and Dataset Clarifications
We thank the reviewer for the detailed comments on loss attribution, masks, and dataset construction.
1. Compact-source loss attribution. Appendix C, Table 5 holds the Stage-1 checkpoint, paired data, training schedule, trainable modules, and evaluation protocol fixed. Removing the source-response group changes PSNR/SSIM/LPIPS from 24.18/0.692/0.243 to 23.10/0.652/0.281, supporting the group's contribution across all three metrics. The quantile term targets global bright-tail statistics, while Lcc penalizes underestimated intensities in selected compact bright regions. This gives complementary global and local constraints. We attribute the measured gain to their combination, rather than to Lcc alone or a particular mask construction.
2. Leakage-mask interpretation and evidence. Equation (7) selects RGB gradients at or above their own quantile threshold and IR gradients below theirs. It therefore identifies candidate texture-leakage regions using modality-relative Sobel gradient magnitudes. Weak IR structure can remain in these regions, so the mask is a heuristic rather than an absence-of-edge test. Table 5 supplies direct evidence for the term: removing it changes PSNR/SSIM/LPIPS to 23.56/0.622/0.268, compared with 24.18/0.692/0.243 for the full objective.
3. Acquisition and scene redundancy. Section 4.1 and Appendix B document shared-timestamp pairing within 20 ms and calibration-board-based spatial alignment. The shift-tolerant objective accommodates small residual translations. THIRAlign's contiguous-sequence split prevents temporally adjacent frames from crossing partitions, providing a concrete safeguard against temporal leakage.