- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes the Sparse Frequency-Aware Transformer, which reduces redundant spikes through staged Haar wavelet decomposition, coefficient thresholding, and channel energy gating, and designs a frequency compensation branch to provide both a parallel mode that balances accuracy and a lightweight mode that reduces parameters. In experiments, the parallel mode achieves 79.70% and 66.44% accuracy on CIFAR-100 and Tiny-ImageNet, respectively, while reducing estimated energy consumption. The lightweight mode further reduces parameters and computational cost, but at the cost of accuracy. Its main value lies in exploring the combination of frequency information and spiking neural network compression. Currently, its performance on neuromorphic datasets is still weaker than strongest reported baselines.
Critical strengths
The direction of frequency-selective sparsity is reasonable.
Critical weaknesses
-
The core definition of "structured pruning" is invalid. The channel-wise gating weight in Eq. (10) is always between 0.4 and 0.6, and the gating itself does not set the channel to zero. Subsequent thresholds can reduce activity, but the paper does not explain how to form pruning entire channels or how to actually skip the corresponding computation.
-
The innovation and controlled ablation studies are relatively weak. The original SWFormer paper already included three-branch frequency mixing, ternary spikes, and axial Haar transform. The novelty of this paper mainly lies in the sparsity and compensation modules, but it lacks direct comparisons with ordinary grouped MLP, frequency-agnostic pruning with shared thresholds, and compression methods such as SparseSpikFormer.
Questions for authors
The "high-frequency compensation" mechanism lacks supporting evidence. The FCP divides the input channel into four groups, which are then referred to as the four wavelet subbands. However, in Figure 2, the input has already undergone inverse transform and other branch fusions. Why do these four groups still have clear frequency identities? Currently, ablation can only support the idea that "adding grouping branches helps," but it cannot fully support the idea that "lost high-frequency information is recovered."