- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes a certainty-guided spiking feature separation framework for early keyword spotting. It derives predictive certainty from normalized entropy and uses it to weight feature separation at each time step, attracting representations toward their class prototypes while enforcing separation from other classes. A weight schedule progressively introduces feature supervision during training. Experiments on GSC V2 and MSWC Microset compare several training objectives and scheduling strategies, showing slightly higher mean accuracy than TET at the reported decision points. However, the main improvements are modest, actual early stopping and energy reduction are not directly evaluated, and several aspects of the loss formulation and implementation require clarification.
Critical strengths
The paper addresses a reasonable concern: uniformly enforcing feature separation when early speech observations contain insufficient evidence may harm representation learning. Using predictive certainty to adjust supervision strength, together with suppressing the auxiliary objective during early training, provides an understandable framework. The auxiliary mechanism is used only during training and requires no additional inference modules. The experiments compare multiple training objectives using the same network architecture and report means and standard deviations across three random seeds, providing stronger evidence than single-run comparisons. Comparisons against uniform separation and alternative weight schedules also offer initial support for the proposed components.
Critical weaknesses
Comment 1: The main improvements are modest, and one performance claim is inaccurate. Compared with TET, Acc@50 improves by only 0.16 percentage points on GSC V2 and 0.12 percentage points on MSWC. Some improvements are comparable to the reported variation across runs and require stronger statistical evidence. Moreover, the text claims the highest accuracy at every evaluated time step on both datasets, but Table 2 reports an MSWC Acc@75 of 90.10%, below the spike-rate baseline at 90.77%. This statement should be corrected, and additional repeated experiments or paired statistical analysis should establish the consistency of the gains.
Comment 2: Accuracy at fixed time points does not establish practical early stopping or energy savings. The evaluation primarily reports classification accuracy at four fixed time steps, without an actual stopping rule, average exit time, or latency comparisons at matched target accuracy. The results therefore support improved prefix classification, but do not directly demonstrate earlier reliable stopping or lower inference energy. Avoiding additional inference modules does not automatically reduce computation. Accuracy versus average decision-time curves, together with corresponding computation or energy estimates, would better substantiate the practical claims.
Comment 3: Predictive certainty is not directly validated as a proxy for informative and reliable observations. Low predictive entropy does not guarantee correctness or establish that the observed speech prefix contains sufficient class information. Although the paper acknowledges this limitation, it does not analyze the relationship between certainty, prediction correctness, and prefix length, or examine confidently incorrect predictions. The authors should also clarify whether gradients are stopped through {\mathrm{D}}{\mathrm{t}}\ . If gradients propagate through it, minimizing {\mathrm{D}}{\mathrm{t}}{\mathcal{L}}_{\mathrm{sep}}\ can also encourage lower certainty rather than solely improving feature separation. Reliability analysis and an ablation of gradient stopping would strengthen the proposed interpretation.
Comment 4: The loss formulation is inconsistent, and important training settings are missing. The weighted separation objective in Section 3.3 includes 1/T, whereas the total objective in Section 3.5 uses an unnormalized temporal sum, changing the auxiliary loss scale by a factor of (T). The text also introduces a maximum schedule weight {\mathrm{\lambda }}{\max}, but the sigmoid formula does not explicitly include this parameter. Under the stated formula, the classification-loss coefficient decreases as λ(e) approaches 1. The implementation should be clarified, and settings for α, margin (m), schedule parameters (\mathrm{k},{\mathrm{e}}{0}), prototype initialization, and network architecture should be provided to make the training behavior assessable and the results reproducible.
Comment 5: Terminology and cross-references need correction. Figure 2(b) is titled "Uncertainty-Guided Feature Separation," whereas the main text, caption, and internal figure label use certainty, and the separation loss is weighted by {\mathrm{D}}{\mathrm{t}}=1-{\mathrm{U}}{\mathrm{t}}. The title should be standardized to "Certainty-Guided Feature Separation." Section 4.3.1 also contains an unresolved "Table ??" reference, which should be corrected in the final version.
Questions for authors
See Weaknesses.