- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents SpikeRED, a spiking object detection framework for RGB images and event streams. The framework employs a dual-branch spiking backbone to extract features from both modalities and an Asymmetric Spiking Fusion (ASF) module to incorporate event information unidirectionally into RGB features. The decoder uses reference bounding boxes to guide multi-scale local feature sampling and enhances object queries through residual updates, progressively refining detection results across decoder layers. Experiments on DSEC-Det and PKU-DAVIS-SOD demonstrate that SpikeRED-L achieves mAP scores of 30.7% and 32.2%, respectively. The paper also reports theoretical inference energy consumption and presents ablation studies on fusion direction, value quantization, and decoder architecture.
Critical strengths
-
ASF enriches RGB features with complementary event information, improving detection accuracy on both datasets while reducing the theoretical inference energy consumption of the entire network compared with the fusion module used in EOLO.
-
Enhancing spiking queries with multi-scale features from object regions improves mAP by 6.8 and 6.9 percentage points on DSEC-Det and PKU-DAVIS-SOD, respectively, compared with a standard spiking attention decoder, with only a small increase in theoretical energy consumption.
Critical weaknesses
-
If the paper aims to emphasize visual tasks in spiking neural networks (SNNs), representative segmentation and tracking algorithms should also be included. Section 2.1 would benefit from broader coverage and a more comprehensive review of the relevant literature.
-
Figure 1 contains several substantial issues. First, the origins of the three scales of features fed into the ASF module are unclear, and Figures 1 and 2 appear inconsistent in this regard. Second, “fusion Feat1” and “fusion Feat2” in Figure 1 appear to have identical spatial dimensions, while the feature dimensions in Figure 2 are not consistently aligned with those in Figure 1. These inconsistencies create considerable confusion and make the proposed architecture difficult to follow. Third, the addition operator in the lower-right diagram has only one input. Together with other serious errors, this renders the diagram difficult to interpret. For example, the origin and role of the neuron depicted between the convolution (Conv) and batch normalization (BN) layers are unclear.
-
The illustrations on the left side of Figure 2 contain an error. In the rightmost image of the first subfigure, the red squares should exhibit different color intensities rather than a uniform shade.
-
Figure 2 illustrates concepts that are already widely known in the SNN literature and do not constitute a contribution of this work. Its inclusion therefore adds little value. Moreover, empirical experience suggests that representing queries, keys, and values (Q, K, and V) entirely as spikes does not lead to substantial performance degradation. Overall, I do not consider this issue a worthwhile research topic, nor does the proposed treatment even qualify as an implementation trick.
-
State-of-the-art accuracy results and other key values in the tables should be highlighted in bold according to a consistent criterion to improve readability. The figures convey very limited information.
-
Overall, the paper exhibits insufficient novelty and lacks adequate analysis of the experimental results. The presentation could also be more concise. I recommend strengthening the methodological contributions and experimental analysis, followed by further revision to improve clarity and conciseness.
Questions for authors
None.
Dear authors, the AC has reminded us reviewers to respond to your rebuttal. If there is anything you would like to clarify or discuss, please leave a comment here, and I will respond as soon as possible.