- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper propose M2C, a matchability-aware mutual-consistency fusion method for RGB–infrared object detection. In detail, this method augments the local RGB candidate set with an explicit no-match state, measures ambiguity through the concentration of the conditional candidate distribution, and verifies the forward correspondence using reverse matchability and forward–reverse soft-offset agreement. The resulting confidence serves as a continuous evidence-admission signal that regulates RGB routing and gates target-aware cross-stage updates to the infrared stream. The experiments on both DroneVehicle and LLVIP is done to demonstrate the effectiveness of M2C across aerial and pedestrian scenes.
Critical strengths
Totally seen, there are some Critical Strengths in this paper. They are listed as follows.
- A matchability-aware mutual-consistency (i.e., M2C) fusion method for RGB–infrared object detection is proposed.
- In scheme, it distinguishs forced local correspondence from reliable evidence admission in RGB–IR detection, and combines no-match, conditional concentration, and reverse verification into a continuous confidence signal that controls RGB routing and infrared feedback.
- Extensive experiments on both both DroneVehicle and LLVIP are peformed to demonstrate the effectiveness of proposed M2c method.
Critical weaknesses
In this paper, there are some Critical Weaknesses.
- In Abstract / Introduction, it is unclear why the M2C is proposed for RGB–infrared object detection (research motivation?). What are the problems existing in current RGB–infrared object detection methods? What's the difference between M2C and others?
- Most figures in this paper, e.g., Fig 1 and Fig 2, are with low quality, even very difficult to see.
- Observed from Fig 1 and its explanations, the novelty of M2C framwork is limited, seeming incremental. The idea of Matchability-Aware could be seen C²Former (2024) / FGSFNet, and the idea of mutual-consistency is also seen in EPNet++ (2021). It could be seen that many other methods adopt similar schemes, e.g., the MCF-YOLO and the BGCF-Net.
- The perforamnce improvement is minor. In table 1 (on DroneVehicle), the gain of M2C is only 0.8 (84.4 vs. 83.6). And, in table 2 (on LLVIP), the mAP50 is only 96.7, less than the 97.0 obtained by Fusion-Mamba.
- Experiment visualization is weak. Only resultant visualization is demonstrated, ignoring the evidences of intermediate process.
Questions for authors
In this paper, there are some concern points to be posted to the authors. Please further clarify or explain or reply these concerned questions below.
1.Existing problems & motivation & differences
In Abstract / Introduction, it is unclear why the M2C is proposed for RGB–infrared object detection (research motivation?). What are the problems existing in current RGB–infrared object detection methods? What's the difference between M2C and others?
2.Figure Quality
Most figures in this paper, e.g., Fig 1 and Fig 2, are with low quality, even very difficult to see.
3.Novelty & Contriubtion
Observed from Fig 1 and its explanations, the novelty of M2C framwork is limited, seeming incremental. The idea of Matchability-Aware could be seen C²Former (2024) / FGSFNet, and the idea of mutual-consistency is also seen in EPNet++ (2021). It could be seen that many other methods adopt similar schemes, e.g., the MCF-YOLO and the BGCF-Net.
4.Perforamnce improvement
The perforamnce improvement is minor. In table 1 (on DroneVehicle), the gain of M2C is only 0.8 (84.4 vs. 83.6). And, in table 2 (on LLVIP), the mAP50 is only 96.7, less than the 97.0 obtained by Fusion-Mamba.
5.Visualization evidences
Experiment visualization is weak. Only resultant visualization is demonstrated, ignoring the evidences of intermediate process.
Thank you for the comments. We have clarified the motivation and contribution and added intermediate evidence. AP below denotes mAP$_{50:95}$.
1. Motivation. A Softmax over real candidates assigns unit mass even when none provides informative RGB evidence. M2C separates real-versus-no-match support, conditional concentration, and reverse verification, then uses their confidence to regulate RGB routing and IR feedback (§§1, 3.2–3.3).
2. Contribution and related work. Appendix G compares the mechanism with C²Former/FGSFNet's attention-based fusion, EPNet++'s prediction-score consistency, MCF-YOLO's IR-prior regularization, and BGCF-Net's bidirectional gating. M2C's specific contribution is the explicit no-match/concentration/reverse-offset chain and its joint use in a routing log-prior and IR residual multiplier. The reverse branch verifies correspondence rather than updating a second feature stream. We credit matching and fusion precedents, including LightGlue.
3. Figure quality. Appendix B adds simplified vector schematics (Figures 6–7), complementing the original Figures 1–2. The main text now defines the projected features, logits, operators, and losses.
4. Performance. We acknowledge the small DroneVehicle mAP${50}$ gain over MDCFT-HSM (84.4 versus 83.6) and lower LLVIP mAP${50}$ than Fusion-Mamba (96.7 versus 97.0; mAP$_{50:95}$: 64.4 versus 64.3). In the controlled comparison, Full's clean advantage over LocalMatch is 0.62 AP points, increasing to 5.45 under RGB replacement. IR-only and joint γ=3 degradation yield advantages of 1.68 and 2.17 (Table 11). IR replacement remains a limitation: 8.78 versus 12.43 AP. We therefore claim selective RGB admission with a usable IR reference.
5. Intermediate evidence. Figures 8–10 and Tables 9–10 add actual maps, input overlays, and dataset-level statistics. Under RGB replacement, P3 foreground confidence falls 0.1772→0.0339, RGB weight 0.2024→0.0383, and actual IR-update RMS decreases 92.95%; individual cues need not all decrease. Routing-prior bypass further reduces RGB-drop AP from 53.53 to 23.43 (Table 12), demonstrating functional dependence within the trained model, not a retrained component's net gain.