- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a probabilistic framework for task-oriented image fusion. The core idea is to model fusion as a conditional distribution guided by source modalities and downstream task information. A latent-variable framework based on variational inference is introduced to transfer task knowledge from a task-informed posterior to a source-conditioned prior, enabling label-free inference. A task consistency constraint further encourages the preservation of task-relevant information. Experiments on two datasets demonstrate competitive fusion quality and downstream task performance.
Critical strengths
- Formulating task-oriented image fusion from a probabilistic perspective provides is an interesting and practical direction.
- The design of posterior-prior framework is reasonable.
- The experiment is relatively comprehensive, covering both image fusion quality and downstream perception tasks, including object detection and semantic segmentation. Component-level ablations and visualizations are also provided.
Critical weaknesses
- The connection between Eq. (5) and the latent variable modeling and training objective is not clear enough.
- The proposed posterior-prior framework is closely related to conditional variational inference and knowledge distillation, the key technical differences from existing probabilistic learning frameworks should be discussed.
- The ELBO derivation involves a likelihood term for the fused image, while the practical training objective relies on intensity and gradient preservation losses without an explicitly defined likelihood model. A clearer explanation of their relationship is required.
- The ablation results in Figure 6 show that removing certain components improves several fusion metrics, which is not fully consistent with the discussion. Also, the optimization objective in Algorithm 1 differs from Eq. (22).
- Some minor typos: (1) In Figure 1, the visible modality is incorrectly labeled as "Infrared B" instead of "Visible B". (2) The reparameterization formula in Figure 2 uses the task-informed posterior during inference.
Questions for authors
Please refer to the Weaknesses.
3 comments
Thank the authors for their replies. All of my concerns are resolved. I do not have further questions.
Reply to Reviewer MdAu
We greatly appreciate your kind recognition. Thanks again for your professional comments.
Response to Reviewer MdAu
Thank you for your constructive comments and valuable suggestions.
Response to W1: Specifically, Eq. (5) establishes the target task-conditioned fusion distribution as the combination of a source-dependent fusion prior and a task likelihood. To make this distribution tractable, we introduce the latent variable Z in Section 3.2 and decompose the fusion process into latent inference and image generation (Eq. (10)). In Section 3.3, the task-informed posterior qϕ(Z∣A,B,Y) is introduced during training to approximate the intractable latent posterior, while the source-conditioned prior pθ(Z∣A,B) is learned through KL divergence alignment for label-free inference. The resulting variational objective (Eq. (22)) consists of the fusion constraint loss and posterior-prior alignment loss. Finally, Section 3.6 incorporates these terms into the overall objective together with task supervision and task consistency constraints. In particular, the fused-image task supervision provides the practical counterpart of the task likelihood in Eq. (5).
Response to W2: Thank you for this insightful comment. We acknowledge that our framework is related to conditional variational inference and knowledge transfer. However, our method differs in its task-oriented formulation and inference mechanism. Unlike conventional conditional variational frameworks, our posterior$q_\phi(Z|A,B,Y)$ incorporates task annotations during training, while the prior pθ(Z∣A,B) relies only on source modalities, enabling task-free inference through posterior-prior alignment. Moreover, unlike conventional knowledge distillation that mainly transfers knowledge through feature or prediction matching, our framework transfers task-related knowledge through latent distribution alignment, complemented by task supervision and prediction consistency constraints. This combination enables task-aware probabilistic fusion without requiring task annotations during inference. We have clarified these connections and differences in the revised manuscript.
Response to W3: Thank you for raising this important concern. We agree that the relationship between the variational likelihood and the practical fusion objective requires further clarification. In our framework, since ground-truth fused images are unavailable, we do not directly define a reconstruction likelihood over the fused image. Instead, we introduce source-derived fusion constraints$\mathbf C_{\mathbf A,\mathbf B}$ and formulate a constraint-based likelihood to evaluate whether the generated fused image satisfies these constraints (Eqs. 16–17). Specifically, the constraints are implemented through intensity and gradient preservation terms, whose negative log-likelihood is explicitly connected to the practical fusion loss in Eq. (21). Based on this formulation, the variational objective in Eq. (22) consists of the expected fusion constraint loss and the KL divergence between the task-informed posterior and the source-conditioned prior. Therefore, the practical fusion loss is interpreted as the negative log-likelihood of satisfying source-derived fusion constraints, rather than reconstructing a predefined ground-truth fused image. We have clarified this relationship in the revised manuscript to make the probabilistic formulation and its practical implementation more consistent and understandable.
Response to W4: We agree that the original discussion did not sufficiently reflect the metric-dependent trade-offs in the ablation results. We have revised Section 4.6 to acknowledge that the full model does not consistently outperform all ablated variants across individual fusion metrics. Instead, we clarify that different components contribute complementary properties, with the full model achieving stronger overall downstream task performance.
Regarding Algorithm 1, we have revised the algorithm to correct the inconsistency in the original optimization procedure and ensure that it accurately reflects the overall training objective presented in Section 3.6.
Response to W5: Thank you for carefully identifying these errors. We have corrected both issues in the revised manuscript. Specifically, in Figure. 1, "Infrared B" has been corrected to "Visible B". In Figure. 2, the inference-stage latent representation has been corrected to use the source-conditioned prior mean μp instead of the task-informed posterior parameters. These corrections ensure consistency with the actual inference procedure.