- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper presents a framework for fusing event camera data with RGB for moving object detection for autonomous driving applications. The paper introduces two ways of fusing the features from event and RGB cameras. The bidirectional feature enhancement uses the response of other feature to modulate its own feature. The deep feature calibration module uses cross attention to fuse the data from the two modalities. The results show minor improvement in accuracy on the DSEC-MOD dataset, and compares with methods from 2024 and earlier.
Critical strengths
The paper extends the idea from RENet paper and adds to it new techniques of fusing the features obtained from event and RGB cameras. It also adds a knowledge distillation path to the architecture that enhances the accuracy.
Critical weaknesses
The novelty of the paper is limited. The ideas presented in this paper are very similar to the RENet paper. The experimental results only include comparisons with papers published in 2024 and earlier. FlexEvent (https://github.com/DylanOrange/flexevent) reports 48.64% mAP on DSEC-mod datset which is quite higher than the 38.99 presented in this paper.
Questions for authors
Questions:
- Can you provide some intiution behind the design of "bidirectional feature enhancement" which uses the response of one feature to modulate the other feature. Aren't these modalities complementary and there may be situations where response of one is weaker while the other is stronger?
- Can you provide more discussion on equation (17), why did you align the features like that. What happens when you do not align the features and use the student features directly with the teacher network?
- Why did you choose E_{30} as input to the student network. Why not E_{50} ? Suggestions:
- Provide results on DSEC-Det dataset also.
- Do more experiments with additional dataset - PKU-DAVIS-SOD (https://www.pkuml.org/research/pku-davis-sod-dataset.html)
- Compare with newer methods
2 comments
Thanks for the revisions and addressing some of my comments. I maintain my rating of 2 for this paper.
Response to Reviewer 1vnj
Thank you for your constructive comments. Our responses are below.
1. BFE design.
RGB and events are complementary, which motivates BFE. A strong response in one modality does not necessarily indicate a detection-relevant feature. Information from the other modality guides feature selection and response adjustment before fusion, allowing complementarity to support mutual guidance rather than only final aggregation.
BFE does not require both modalities to respond strongly. When a scene favors RGB, learning tends to yield stronger RGB responses and weaker event responses, reflecting their complementarity.
2. Alignment in Eq. (17).
Teacher and student features have compatible dimensions, but differ in their statistics. Mean and standard-deviation alignment adjusts offsets and scales while preserving relative spatial responses within each channel. Unlike a learnable convolutional mapping, it adds no learnable parameters or adaptation-layer optimization.
Student features can still enter the frozen teacher head, but it was trained on teacher features with different channel-wise means and standard deviations. Prediction discrepancies may therefore reflect numerical scale mismatch as well as detection-information differences, interfering with distillation supervision.
On paired samples, the average absolute differences between teacher features and unaligned student features at their detection-head inputs were 0.1044 in channel-wise means and 0.2797 in standard deviations. This indicates feature-statistics discrepancies and supports the alignment strategy.
We further conducted an ablation by removing the alignment in Eq. (17) while retaining the remaining model components. As shown below, alignment improves all three metrics, supporting its effectiveness.Ablation settings are provided in Appendix A.8.
3. Student event window.
A longer window is not necessarily better: short windows may yield incomplete object structures due to event sparsity, while long windows may accumulate more background responses and motion trails. We choose 30 ms to balance information completeness and interference. As shown below, 30 ms achieves the highest [email protected] among the three evaluated windows, supporting this choice.
4. DSEC-Det experiments.
We added experiments using the SFNet-released eight-class annotations and split.For a fair comparison, baselines use the same input resolution and training epochs as our model; details are provided in Appendix A.9. Differences from original studies in input scales, augmentation and training settings may contribute to discrepancies in absolute accuracy.
Our method achieves 33.14% AP50, 8.04 points above RENet and close to SPFD (34.20%), supporting its applicability to general traffic object detection beyond moving-object detection.
5. PKU-DAVIS-SOD experiments.
Following your suggestion, we added experiments on the low-light subset of PKU-DAVIS-SOD using Ours, the RENet teacher, and SPFD, the runner-up method in our main comparison. We compare these methods under the same protocol described in Appendix A.9, with results shown below:
6. Comparisons with recent methods.
Following your suggestion, we have added comparisons with ACGR (CVPR 2025) and SPFD (CVPR 2026) to the updated comparison table, extending our evaluation to more recent RGB-event object detection methods.
We sincerely thank the reviewer for the valuable feedback and constructive suggestions.