- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes PSDFusion, a prior-guided framework for infrared-visible image fusion. The method introduces feature specialization to construct complementary local-detail and context-preserving representations before semantic conditioning. It further employs cross-paradigm distillation to integrate Euclidean and hyperbolic-aware representations under multi-level teacher supervision. Experiments on four fusion benchmarks and two downstream perception tasks demonstrate competitive fusion quality and generalization performance.
Critical strengths
- Well-motivated framework. The paper addresses meaningful limitations in semantic-guided fusion and knowledge distillation. The integration of feature specialization and cross-paradigm distillation provides a coherent approach to improving multimodal representation learning.
- Comprehensive empirical validation. The method is evaluated against 12 representative baselines across four benchmarks, with additional semantic segmentation and object detection experiments. The strong results on MSRS and competitive cross-dataset performance support the practical value of the proposed framework.
Critical weaknesses
- Limited explanation of geometric benefits. Although the cross-paradigm design is interesting, the specific advantage of the hyperbolic-aware pathway over conventional Euclidean refinement could be explained more clearly, particularly since spectral interactions are performed in the tangent space.
- Trade-offs in the ablation results. Table 3 shows that removing PFS or CPD improves certain metrics, particularly MI and IFC. Further clarification of these trade-offs would strengthen the justification for combining the two components.
Questions for authors
- Could the authors clarify the specific role of the hyperbolic-aware representation, especially when spectral operations are performed in the Euclidean tangent space?
- How do the authors interpret the higher MI and IFC values achieved by some ablated variants in Table 3? Does the full model primarily emphasize structural and edge preservation?
- Could the authors clarify whether the reported inference time includes text encoding and confirm the role of the teacher network during inference?
- Could the authors clarify why three distillation levels are selected and how this choice affects fusion performance?
- Could the authors explain why scene-level captions outperform generic prompts on most structural metrics, as shown in Table 10?
6 comments
Response to Q2: Interpretation of ablation trade-offs.
We agree that removing PFS or CPD improves MI and IFC, reflecting a trade-off rather than uniform gains. These information-based metrics characterize different properties from structural and edge preservation. Our objective (Eq. 20) jointly optimizes intensity fidelity, gradient preservation, and multi-level correlation distillation, without directly maximizing MI or IFC. Accordingly, the full model places greater emphasis on structural fidelity, achieving higher AG (5.883) and ED (52.00) than w/o PFS (5.604/49.89) and w/o CPD (5.649/50.10), while maintaining competitive Qab/f and Qcb. We recognize the higher MI/IFC of ablated variants as valid advantages on those metrics, rather than evidence of inferior fusion. We will clarify these metric-dependent trade-offs instead of claiming uniform component improvements.
Response to Q3: Inference protocol.
The reported inference time (0.4067 s/image, Table 12) measures the fusion network's forward pass using precomputed text embeddings, excluding online BLIP-2 encoding. Text-conditioned interaction remains active through these embeddings (Eq. 10). The frozen MiT-B3 teacher is used exclusively during training for multi-level correlation distillation (Eqs. 2 and 18) and is completely removed during inference, together with the distillation branch. We will explicitly clarify this timing scope and the teacher's training-only role in the revision.
Response to Q1: Role of hyperbolic-aware representation.
We thank the reviewer for the careful evaluation and constructive feedback. We address these concerns below.
The tangent space provides Euclidean coordinates for FFT, but this does not mean the entire hyperbolic-aware pathway reduces to Euclidean spectral processing. Beyond coordinate mappings, this pathway incorporates hyperbolic-aware nonlinear refinement and teacher-conditioned modulation to construct an alternative student representation before distillation. The two representations are subsequently integrated and aligned through Euclidean feature correlations (Eqs. 16–18), rather than explicit hyperbolic metric supervision. Importantly, Table 3's Eul-only and Hyp-only replace E/H with E/E and H/H, respectively, rather than removing one branch. The mixed E/H configuration achieves higher AG, ED, and Qcb than both controls, supporting the value of complementary refinement. We will clarify these operations and ablation settings in the revision.