- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces FAPE, an input encoding framework for static images in SNNs. FAPE integrates multiple encoding schemes: bursts, TTFS, and rate coding, together with leverages multi-scale local image features to predict corresponding mixing weights at each spatial location and simulation time step. The resulting continuous-valued current drives a fixed SNN backbone. Experiments on the CIFAR-100 and ImageNet32 datasets demonstrate that this spatial allocation strategy offers significant advantages over baseline methods employing global or static gating. Furthermore, by comparing this approach with direct encoding, the study explores the extent to which these performance gains depend on the chosen representational forms and their temporal presentation.
Critical strengths
- The strategy of hybrid encoding has been proven effective in many studies; here, the authors further emphasize that applying hybrid encoding to the image modality is beneficial. FAPE uses local image context to learn spatially varying mixtures of Burst, TTFS, and Rate codes while preserving the SNN backbone. This provides a concrete mechanism for adapting input encoding to local image content and examining its contribution independently of backbone modifications. (importance 7/10)
Critical weaknesses
- The scope of the benchmarking is limited, and the results lack sufficient comparability. This evaluation is restricted to the CIFAR-100 and ImageNet32 datasets, both of which utilize an input resolution of 32×32. Although ImageNet32 contains a large number of images, the evaluation results cannot be directly compared with those from standard ImageNet benchmarks commonly used in representative research within the field of Spiking Neural Networks (SNNs). Furthermore, as the study focuses exclusively on low-resolution inputs, the effectiveness of the proposed "local spatial allocation" mechanism remains unverified for high-resolution data. (importance 9/10)
- Unclear research motivation: The introduction notes that pointwise encoders overlook the local structure of images, yet it fails to explain why different structures should necessitate different temporal encodings, nor does it propose a clear, testable hypothesis. Consequently, the proposed allocation mechanism lacks a well-defined scientific question. Furthermore, the strong performance of the DC baseline—along with the observed performance gains when using time-averaged repeated inputs—underscores the need to disentangle the respective contributions of spatial allocation, candidate representations, and temporal variation. In the abstract and introduction, the authors should explicitly articulate the specific scientific question this study aims to address and clarify how the experiments are designed to investigate that question. (importance 10/10)
Questions for authors
larification requests: None
suggestions for future work:
- The authors did not provide certain supplementary visualizations that would highlight the advantages of their encoding scheme—visualizations that would have been highly beneficial for the paper and its novel contributions.
- The information presented in the author’s main figure is overly complex, making it difficult to quickly grasp the core innovations and theoretical contributions; consequently, the figure does not effectively support the text. The author should reconsider the design of the figure to ensure that readers can promptly identify the key elements that highlight the paper’s contributions.