- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates a method centered on Logarithmic Ternary Integrate-and-Fire (LTIF) neurons, achieving a spiking representation of large-model activations within a maximum of four time steps through ternary spike firing, membrane potential responses based on powers of two, grouped adaptive scaling, and selective encoding of outliers. However, the paper submission violates the submission guidelines: https://iclr.cc/Conferences/2027/AuthorGuidelines
Critical strengths
- This paper proposes a short-window spike-driven quantization aiming to preserve both normal values and outliers without long firing windows or auxiliary non-spiking computation paths.
- This paper introduces QuantaSpike, a post-training framework centered on the LTIF neuron. LTIF combines ternary spike decisions with power-of-two membrane-response quanta within a four-step firing window.
Critical weaknesses
- The paper lacks an "AI Use Statement," which violates the ICLR 2027 submission guidelines (https://iclr.cc/Conferences/2027/AuthorGuidelines).
- There is a lack of validation regarding energy consumption and inference efficiency on actual hardware. The paper's claims of energy efficiency advantages are primarily based on theoretical computational cost estimates; actual latency, throughput, and energy consumption were not measured on neuromorphic hardware.
- The model incorporates non-linear operators such as Softmax, RMSNorm/LayerNorm, and SiLU. The authors need to clarify which operators implement spike-driven computation versus those that still rely on floating-point operations, as well as the actual spiking ratio of the entire model.
- The ablation studies are insufficient; specifically, there is a lack of ablation experiments regarding factors such as grouping size and time steps.
Questions for authors
- How is the "group-wise scaling" described in the paper stored online or implemented?
- Does the encoding scheme in the paper require identifying every outlier and encoding each one individually?