- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In view of the core view that the difference between infrared and visible images can be used as signals in the research of visible infrared image fusion, this paper proposes how to better use the frequency domain information to effectively model the contribution of dual-mode images, and realize the effective autonomous fusion of visible infrared images. Based on the two frequency-domain curves proposed by the author, one represents the difference intensity and the other represents the fusion difference preference, the network can dynamically determine whether to believe in infrared or visible images in different frequency bands, and realize the final fusion. The paper evaluates the performance on four public fusion datasets and two downstream tasks, and obtains excellent results.
Critical strengths
1. aiming at the topic of the selection of fusion strategy in the field of visible and infrared image fusion, the paper chooses to fully mine the information of modal differences. The advantages of infrared and visible light will change with the scene, frequency and degradation degree, so it is of practical significance to adjust the fusion strategy according to the frequency band. It is more complete to separate "how much difference" and "which modal structure has stronger response" than to use only residual strength.
2. the Modality Residual Curve (MRC) proposed in this paper is easy to understand and is a delicate design, which improves the interpretability of the fusion strategy in image fusion, which is enlightening for other researchers.
3. the paper gives the results of four public data sets, which makes the results of the paper more convincing.
4. in addition to the necessary comparative experiments, computational efficiency experiments, ablation experiments, and downstream task experiments, the paper also launched the controlled behavioral analysis, which is a commendable design.
Critical weaknesses
1. in Figure 6 (b), page 9, plots as the visible input is blurred. Section 4.5 describes this as a decrease in "reliance on the visible modality." The figure also shows qualitative fused outputs, but it does not measure routing weights, cross-attention contributions, or causal output sensitivity to either input. Its curve demonstrates that the designed prior responds to a particular blur example; it does not establish the claimed change in the learned network's modality reliance or aggregate robustness.
2. the pipeline structure given in the paper is very simple, but the corresponding code is not provided.
3. in Figure 3 of the paper, it can be clearly seen that for an area with a large proportion of sky such as FMB dataset, the method of the paper will make the sky dark, which proves that the method proposed in the paper can not completely achieve the modal selection in line with human observation.
4. the relevant discussion in the paper is relatively thin in the selection of loss function, and there is no additional control of the loss of the influence of MRC curve on fusion, which weakens the persuasiveness of the model and may even lead to overclaim.
Questions for authors
1. Tables 1 and 2 contain 218 baseline values identical to those in TDFusion (CVPR 2025), with only six changed entries. Please identify which scores were imported and which were independently recomputed, explain the six differences, and clarify the statement that SegFormer and YOLOv8 were retrained. For recomputed results, please provide the evaluation configuration, checkpoint or prediction provenance, run logs, and seeds.
2. Please explain the first point in Critical Weaknesses.
3. Can the author provide a code demo to better understand the proposed MRC?
4. Can the author give a more detailed discussion on points 3 and 4 in Critical Weaknesses?
5. The author uses MoE to assist in the generation of fused images. Do you use balance loss in the process of using MoE?
6. The author's pipeline structure is very simple, but the parameter quantity is not small. Are there some parts omitted in Figure 2?