- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes Membrane-Aware Dynamic Sparse Training (MADST) for federated spiking neural networks. It uses a neuron’s proximity to its firing threshold to adjust connection-pruning scores. New connections are selected based on presynaptic spikes occurring when the target neuron is near its threshold. The server combines client masks by prioritizing connections supported by more clients while maintaining a fixed density in each layer. Experiments on CIFAR-10 and CIFAR-100 with Spiking ResNet-18 show the highest accuracy in 10 of 12 matched-density settings.
Critical strengths
1. Incorporating membrane state into connection selection is well motivated for SNNs. The growth rule considers whether a source spike occurs when the target neuron is sensitive to additional input, providing a more specific criterion than firing activity alone.
2. The matched-density comparisons show promising improvements over existing sparse-training methods. The component ablations also suggest that server-side mask reconciliation matters, particularly on CIFAR-100 under non-IID data. Keeping membrane statistics local avoids introducing a separate communication requirement for these signals.
Critical weaknesses
1. The evidence for the proposed activity-coupling mechanism is not sufficiently convincing. The growth ablation compares against random growth rather than simpler activity-based scores, so it does not isolate the value of same-time spike–membrane coincidence. Tables 1–3 also lack variability estimates. Together, these limitations make it difficult to determine whether the central mechanism provides a reliable improvement.
2. The practical efficiency and federated robustness remain insufficiently established. The communication analysis counts weight values without quantifying mask or index overhead, and the additional training time and memory required for growth scoring are not measured. Moreover, evaluation uses only ten fully participating clients, leaving unclear whether support-first alignment remains effective with a larger population or partial participation. These gaps limit the evidence for deployment on resource-constrained federated systems.
Questions for authors
1. How do the membrane time constant and surrogate slope affect the importance scores? Does a larger time constant make the omitted lagged contributions important enough to change which connections should be grown?
2. Can you compare the joint growth score with the product of average presynaptic activity and average postsynaptic membrane sensitivity? How much improvement comes specifically from their same-time coincidence?
3. How does support-first alignment behave under partial client participation and stronger data heterogeneity? Does prioritizing majority support remove connections that are useful mainly to clients with less common classes?
4. Does the communication analysis account for the bit overhead of transmitting masks or indices? Since growth scoring requires additional computation and a weight-shaped buffer, how much local training time and peak memory does it add?
5. What motivates the choice of ten fully participating clients? Does MADST retain its advantage with a larger client population, such as 100 clients, particularly when only a subset participates in each round?
6. The heading formatting in Section 2 is inconsistent. “Dynamic Sparse Training” appears on a separate line, while the other headings run into the following text.
Thank authors for the response and the clarifications. However, the rebuttal provides no new experimental evidence for its claims. Most of the works are described as planned work. The communication savings are analytical estimates. The only reported training-time and memory profiling, comes from a separate implementation and does not use the same setting as paper. Since the core concerns remain unresolved, I will maintain my score.