- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 1
Read review
Paper summary
This paper proposes QuEST, a quality-guided framework for event-based object detection that aims to improve the allocation of computational resources and temporal memory updates. Built upon SMamba, QuEST introduces a shared quality field estimated from event statistics to coordinate three components: Select, which guides sparse token selection; Scan, which modulates state-space integration; and Write, which regulates recurrent memory updates. Additionally, a foreground-preserved consistency training strategy is introduced to improve robustness against variations in background event statistics.
Critical strengths
-
The proposed method integrates token selection, state-space integration, and recurrent memory updates through a shared quality field.
-
The method is evaluated on three event-based object detection datasets, including Gen1, 1Mpx, and eTraM, and achieves consistent performance improvements
Critical weaknesses
-
The research problem and motivation are not clearly articulated, and the analysis of existing challenges in the field lacks sufficient depth. As a result, it is difficult to identify the central focus and key contributions of the paper. The proposed method appears to be primarily an engineering-oriented extension of SMamba rather than a fundamentally novel methodological contribution. Moreover, the logical organization, coherence, and overall readability of the manuscript require substantial improvement
-
The authors should provide comprehensive efficiency comparisons with existing methods, including computational complexity and inference latency.
-
In the ablation studies, the performance improvements introduced by Scan and Write are relatively marginal. Are these gains consistent across different random seeds? The current experimental results are insufficient to convincingly establish the effectiveness of these components.
-
Why is an additional Write gate introduced on top of the existing input and forget gates in ConvLSTM? Could similar effects be achieved by directly modulating the original ConvLSTM gates? Given the marginal performance improvement attributable to Write, stronger experimental evidence is needed to justify its necessity and effectiveness.
-
The authors should compare the proposed quality-guided token selection strategy with existing approaches, such as SMamba and SAST, as well as more advanced visual token selection methods. Such comparisons are essential to demonstrate the advantages of the proposed selection mechanism over existing alternatives.
-
All five evaluated perturbations are artificially constructed modifications of event statistics and closely resemble the perturbation types used during training. Even though foreground preservation is not applied during testing, the resulting distributions may still be similar to those covered by the training augmentations. More importantly, the baseline model is barely affected by these perturbations, suggesting that the current evaluation is insufficient to demonstrate the robustness and generalization capability of QuEST under realistic environmental shifts.
Questions for authors
See weaknesses
9 comments
Response to Reviewer N2yE (II/VI)
(W2) The authors should provide comprehensive efficiency comparisons with existing methods, including computational complexity and inference latency.
Reply 2: We thank the reviewer for this suggestion. Our paper reports model parameters, backbone FLOPs, and inference runtime to evaluate both model complexity and practical inference cost.
We summarize the efficiency comparison with representative event-based detectors, including RVT, SAST, and SMamba:
| Method | Gen1 AP | Params (M) | FLOPs (G) | Runtime (ms) |
|---|---|---|---|---|
| RVT | 47.2 | 18.5 | 3.5 | 10.2 |
| SAST | 48.2 | 18.9 | 2.4 | 22.7 |
| SMamba | 50.4 | 16.1 | 2.4 | 24.8 |
| QuEST (Ours) | 52.0 | 16.3 | 2.7 | 22.0 |
QuEST achieves the highest detection accuracy among the listed methods, with fewer parameters than RVT and SAST and a modest parameter increase over SMamba. Using QuEST’s AP of 52.02, the improvements over RVT and SAST are 4.82 and 3.82 AP points, respectively. Compared with SMamba, QuEST improves AP by 1.62 points, with a similar model size and a shorter measured runtime (22.05 ms vs. 24.84 ms).
We also provide a controlled comparison with our architecture-matched Activity-only baseline. Both models retain exactly 50% of tokens at every stage:
| Metric | Activity-only | QuEST |
|---|---|---|
| AP | 50.72 | 52.02 |
| AP75 | 52.76 | 54.64 |
| Parameters (M) | 16.070 | 16.322 |
| Backbone FLOPs (G) | 2.576 | 2.731 |
| Runtime (ms) | 20.51 | 22.05 |
| Token retention | 50% | 50% |
The 1.30-point AP improvement comes with 1.57% additional parameters and 6.02% additional backbone FLOPs, while runtime increases by 1.54 ms. The number of tokens processed by selective scanning remains unchanged; the additional computation comes from the quality-guided control components.
Together, these comparisons demonstrate improved detection performance at identical per-stage scan cardinality, with modest increases in model size and inference cost relative to the architecture-matched Activity-only baseline.
Response to Reviewer N2yE (III/VI)
(W3) In the ablation studies, the performance improvements introduced by Scan and Write are relatively marginal. Are these gains consistent across different random seeds? The current experimental results are insufficient to convincingly establish the effectiveness of these components.
Reply 3: We appreciate the reviewer’s concern regarding training variability. Our controlled ablations show positive incremental gains from both components. With the backbone, neck, head, quality supervision, and per-stage token retention held fixed, adding Scan improves Gen1 AP from 51.14 to 51.43, and subsequently enabling Write increases AP to 51.86. Together, Scan and Write provide a 0.72-point AP improvement over quality-guided selection alone.
Our implementation follows the recurrent streaming training and evaluation framework established by RVT, which is also adopted by subsequent event-based detectors such as SAST and SMamba. In this setting, training combines streaming sequence sampling and randomly sampled sequences, with recurrent states and data ordering handled across successive event intervals. Reproducibility through conventional global seed control is not straightforward. In particular, the RVT implementation explicitly disables PyTorch Lightning’s global seed setting because of unresolved issues with shuffling during streaming-dataset training, as reflected in the training log in RVT Issue #39.
The published RVT, SAST, and SMamba results also report individual benchmark scores rather than systematic mean ± standard deviation results over multiple independent training seeds. Following this established training and evaluation protocol, we report our controlled ablations under the same setting. These results quantify component gains under the adopted protocol; they do not quantify variability across independent training runs.
To complement the detection results, we further examined how Scan and Write use the quality signal to influence state processing. With token selection unchanged, independently replacing the quality inputs to Scan and Write with constant or spatially shuffled maps produces measurable changes in downstream features and recurrent states. These interventions show that quality affects state processing beyond its role in token selection.
For Scan, inspection of the actual selective-scan tensors confirms that quality modulates the effective integration steps and state-transition behavior. For Write, the full-test-set spatial analysis shows higher average write rates in foreground regions, indicating a stronger contribution from candidate states in object-related regions. Temporal recovery analysis further shows that hidden-state and cell-state deviations progressively decrease after temporary perturbations are removed, accompanied by improved prediction consistency.
Together, the controlled AP comparisons and mechanism-level analyses support the complementary contributions of Scan and Write within the evaluated framework: Scan regulates integration along the selected token sequence, while Write controls the incorporation of candidate states into recurrent memory.
Response to Reviewer N2yE (I/VI)
We sincerely thank the reviewer for taking the time to carefully evaluate our work and provide detailed feedback. The comments have encouraged us to further examine the motivation, methodological choices, and experimental evidence of QuEST.
(W1) The research problem and motivation are not clearly articulated, and the analysis of existing challenges in the field lacks sufficient depth. The proposed method appears to be primarily an engineering-oriented extension of SMamba rather than a fundamentally novel methodological contribution. Moreover, the logical organization, coherence, and overall readability of the manuscript require substantial improvement.
Reply 1: We thank the reviewer for pointing out the need to clarify the research problem and methodological contribution.
Our motivation starts from an important distinction in event-based detection: event activity indicates where changes occur, but does not necessarily indicate which observations are relevant to object detection. Existing sparse detectors, such as SAST and SMamba, have explored adaptive computation allocation through scene-adaptive sparsity and event-guided token selection. However, in recurrent detectors, spatial selection and temporal persistence are closely coupled. The tokens admitted for processing determine the evidence available to subsequent state updates, while recurrent writing determines how this evidence influences future intervals.
This motivates the central question of QuEST: under a fixed per-stage token budget, how should a detector coordinate which evidence is processed, how it is integrated, and how it is retained over time?
QuEST addresses this question through a shared, detection-supervised quality field derived from five explicit event statistics. It coordinates three operations:
The contribution is therefore the coordination of spatial evidence selection, within-interval state integration, and cross-interval memory updates through a common detection-relevance signal, rather than simply adding independent modules to SMamba.
Our controlled ablations support this design. At 50% token retention, Select improves Gen1 AP from 50.72 to 51.14. Adding Scan increases AP to 51.43, and enabling Write further increases it to 51.86. Training regularization brings the final result to 52.02 AP.
We have also conducted additional experiments to examine these design choices. Independent quality heads achieve 52.0762 AP, compared with 52.0197 AP for the shared-field design, demonstrating comparable detection performance with a more unified controller. Density-only estimation achieves 51.0790 AP, 0.9407 points below full QuEST. Direct modulation of the original ConvLSTM gates achieves 51.7119 AP, compared with 51.86 AP for the proposed Write design. Further mechanism diagnostics show that the shared quality field independently influences Scan and Write, while temporal analyses reveal progressive recurrent-state and prediction recovery after temporary input perturbations are removed.
We also take the reviewer’s comment on presentation seriously. We will make the relationship between activity-based selection, detection relevance, and temporal memory more explicit in the Introduction, strengthen the comparison with SAST and SMamba in Related Work, and improve the transitions between quality estimation, Select, Scan, and Write in the Method section.