- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SPDVF, a unified infrared and visible video fusion framework based on SPD manifolds, aiming to improve spatial fusion quality and temporal consistency simultaneously. Specifically, the authors represent local image regions using SPD covariance descriptors and map them into a shared Log-Euclidean tangent space. The proposed framework consists of three main components: LECA for cross-modal feature interaction, BKB for spatial detail refinement, and LEM for temporal information propagation without explicit optical flow estimation. Experiments are conducted on three benchmark datasets, M3SVD, HDO, and VTMOT, demonstrating promising performance in terms of spatial fidelity and temporal consistency.
Critical strengths
-
The idea of unifying spatial fusion and temporal modelling within a shared Log-Euclidean SPD representation is interesting. It provides a different perspective on infrared and visible video fusion by exploiting second-order statistical information.
-
The proposed framework integrates several complementary components to address cross-modal interaction, spatial detail preservation, and temporal consistency. The overall architecture is reasonably designed and technically sound.
-
The authors conduct extensive experiments on three benchmark datasets and compare their method against several representative approaches. The quantitative results are promising, and the ablation experiments further demonstrate the effectiveness of the proposed components.
Critical weaknesses
-
Although the authors explain the motivation behind the proposed framework in the Introduction, the paper lacks an intuitive illustration highlighting the differences between SPDVF and existing video fusion approaches. I suggest that the authors include a conceptual comparison figure to demonstrate the limitations of conventional methods and explain how the proposed unified representation addresses these limitations.
-
According to Table 3, the proposed method does not demonstrate a clear advantage in computational efficiency. In particular, SPDVF requires 953.1 GFLOPs, substantially more than the competing approaches, and its inference time is also considerably longer than that of VideoFusion and TemCoCo. Given that computational efficiency is particularly important for video fusion, such a significant computational overhead raises concerns about the practicality of the proposed method.
-
The construction of SPD covariance descriptors plays a central role in the proposed framework. However, the influence of important design choices, such as the covariance window size, descriptor dimension, and shrinkage coefficient, remains unclear. Additional sensitivity experiments would help demonstrate the robustness of the proposed representation and provide further justification for these configurations.
-
Although Section 4.4 presents object detection results using YOLOv11, the evaluation is restricted to qualitative comparisons. It would be more convincing to provide quantitative results, such as mAP and recall, to demonstrate whether the improved fusion quality translates into better downstream performance.
Questions for authors
Please refer to the Critical Weaknesses section.