- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the issues with existing infrared and visible light image fusion methods—namely, that most are only suitable for low-light environments, and that luminance restoration and texture compensation are mutually coupled, leading to unstable performance under variable lighting conditions—by proposing PTFusion. This method decouples the luminance prior from the texture prior; the luminance prior maps images taken under different lighting conditions to a unified, normal-illumination feature space to achieve luminance adaptation, while the texture prior uses a multi-gradient operator to extract high-frequency details for texture compensation and incorporates object-aware constraints to preserve infrared object information. The fusion process utilizes both priors to simultaneously perform feature injection and loss supervision.
Critical strengths
The paper proposes a model for image fusion under low-light, normal-light, and high-light conditions. The paper is well-written and flows smoothly overall.
Critical weaknesses
There are significant issues with ablation. The article does not adequately explain the theory.
Questions for authors
- Equation 8 requires a more detailed explanation. Why does the network need to extract texture information? Wouldn’t it be better and more accurate to obtain it directly using the Sharpe, Sobel, LOG, and Laplacian operators?
- Your ablation results are shown in Figure 4, not Figure 3. There is an error here. The authors need to provide results based on objective metrics to demonstrate the validity of the ablation. Wouldn’t it be better to directly inject texture information into the features rather than using texture information extracted by the network? The authors need to include comparative experiments in the ablation analysis. Additionally, experimental results under high-exposure conditions should be provided.
- In the texture information injection module, the model selected four gradient operators. However, in the loss function, the model only calculates the loss with the Sobel operator, which is unreasonable.
3 comments
The author answered my question.
Thank you very much for the professional, detailed, and constructive comments provided by the reviewer during the review process.
We particularly appreciate your valuable suggestions regarding the texture supervision mechanism. Your comments are highly insightful and have provided important guidance for us to further improve and strengthen our work. Based on your suggestions, we have added the corresponding theoretical explanations and experimental results to the revised manuscript and further improved the relevant content. We sincerely appreciate your constructive suggestions and the valuable guidance they have provided for our work.
Thank you again for your careful and professional review. Your valuable feedback has been very helpful in further improving the methodology, technical presentation, and experimental validation of our paper. Therefore, we sincerely hope that you could reconsider your overall evaluation and score of the paper based on the revised manuscript and the additional experimental results. If you find that our revisions and additional results have adequately addressed your concerns, we would be very grateful if you could consider raising the score accordingly.
Thank you again for your careful review and valuable constructive feedback.
R1
Traditional operators are used to extract texture responses that already exist in images, while our texture prior network aims to learn texture compensation representations under lighting degradation conditions. When an image is affected by degradation such as low light or overexposure, some texture information may be weakened, and it is difficult to effectively compensate for these degraded information by directly applying fixed operators. Therefore, we introduce a learnable texture prior network to learn texture compensation representations under different lighting conditions.
Formula (8) can be further expanded as:
LT=LS+LC+LL+LG
where the four terms are defined as:
Where:
R2
Thank you to the reviewer for your careful review and valuable suggestions. We will correct this issue in the revised draft and check the relevant captions.
Due to the limitation of the original manuscript length, we mainly presented the qualitative ablation results of photometric and texture priors through Figure 4. We have added quantitative ablation experiments.
Partial ablation configurations achieved higher results in evaluation metrics, which is related to PTFusion's photometric recovery and texture compensation mechanisms. These operations will alter the brightness, contrast, and local texture response of the fused image relative to the original source image, thereby affecting some evaluation metrics based on source image consistency. Therefore, changes in a single indicator cannot fully reflect the impact of photometric restoration and texture compensation on fusion quality. The goal of PTFusion is to improve the photometric adaptability and structural preservation ability of fusion results under complex lighting conditions through the synergistic effect of photometric and texture priors.
Under complex lighting conditions, our method exhibits smaller fluctuations in cross illumination performance, demonstrating the good stability of the dual prior mechanism in maintaining structure.
The visual results in Figure 4 demonstrate the role of photometric priors in improving the visibility of degraded areas, as well as the contribution of texture priors in compensating for local details.
R3
Thank you very much to the reviewer for providing this valuable suggestion. Based on the suggestions of the reviewers, we further improved the texture supervision mechanism in the fusion stage by extending the original Sobel single operator gradient constraint to a multi operator joint supervision of Sobel, Scharr, Laplacian, and LoG, allowing different types of edge and texture information to jointly participate in the optimization of the fusion network. We have conducted supplementary experiments on this improvement, and the experimental results show that the introduction of multi operator joint supervision further improves the fusion performance of the model, fully reflecting the positive role of this suggestion in improving our method. We will supplement the improved experimental results in the revised manuscript and express our sincere gratitude to the reviewers for their constructive suggestions in the official version.