- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies multi-target detection and 6D pose estimation based on event cameras, and proposes a spiking neural network framework EventGeoPose for direct training. The model uses existing I-LIF neurons to improve the numerical expression of continuous attitude regression through integer value training, and expands integer activation into binary spike during inference. In addition, the author constructed two datasets, EVA-6D-Syn and EVA-6D-Real. The experiment covers the above dataset and publicly available YCB-Ev SD, reporting pose accuracy, component ablation, time step sensitivity, and theoretical inference energy consumption. The complete model exceeded the listed external baselines on all three datasets, but the same structured ANN variant had higher accuracy on synthetic data.
Critical strengths
1. Performance improvement covers both publicly available synthetic benchmarks and real data. The complete model achieved 71.2%, 34.7%, and 56.8% on EVA-6D-Syn, EVA-6D-Real, and YCB-Ev SD, respectively, surpassing the strongest listed external baselines by 11.8, 12.5, and 20.7 percentage points. The use of Ours-TS with the same Time Surface input also has advantages, indicating that the results are not entirely derived from differences in input representation.
2. Component ablation provides clear internal evidence. In Table 4, the basic SNN is 62.5%, and after adding PRAEE and EGCR separately, it reaches 65.7% and 66.1%, respectively. When used in combination, it reaches 71.2%. Table 5 further shows that after removing the event rate channel, it decreased to 67.6%, indicating the importance of supporting duration information for adaptive binning. The author also reported that ANN variants have higher accuracy, and increasing the time step does not always improve the results, which helps to understand the trade-offs of the method.
Critical weaknesses
W1. Table 6 reports that the theoretical energy consumption of I-LIF is 135.5 mJ and ANN is 866.7 mJ, but the main text and appendix do not clearly provide the operation count, single operation energy consumption, activation statistics, and calculation boundaries. Especially according to equation (6), integer activation needs to be expanded into multiple binary pulses, and the number of synaptic accumulations should reflect the activation amplitude, rather than relying solely on non-zero activation ratios. Due to the accuracy of ANN being 76.6%, which is higher than the 71.2% of I-LIF, the energy efficiency evidence directly determines the main value of using SNN.
W2. All major results are based on ADD(-S), which follows the setting of YCB-Ev SD. However, a single loose threshold is difficult to determine whether the improvement continues to meet stricter pose requirements. Appendix B.3 allocates the first 60% of each real sequence for training and the last 40% for testing. This reduces random interleaving while still sharing the collection environment, objects, and motion sequences. Therefore, 34.7% of the results support evaluation within the same collection sequence, which does not fully demonstrate generalization to independent recording sequences.
Questions for authors
Q1. Please provide the energy consumption formulas, MAC/AC operation quantities, single operation energy consumption assumptions, and activation statistics for ANN, LIF, and I-LIF. Does I-LIF count the number of binary spike after unfolding based on integer activation amplitude and include them in all time steps? What calculations are included in event encoding, neuron update and detection, and pose head?
Q2. Do the event windows on both sides of the training and testing boundary overlap, and are time intervals set? Can existing recording data be used to supplement independent sequences for evaluation and distinguish between normal and low light conditions?
Q3. The event distance field use the entire scene event or restrict the target instance? How to avoid the projection edge being attracted to event structures that do not belong to the object when a large number of events are generated by multiple targets, background edges, or dynamic lighting?
Q4. The energy consumption calculation is based on theoretical inference energy, but the experiment was not tested on the edge computing platform.