- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DSMamba-NeRF, a spiking neural network framework for high-fidelity neural radiance field reconstruction. The authors identify geometric fragmentation and floater artifacts as two key limitations of existing SNN-based NeRF methods and introduce three components to address them: a decoupled Spiking Mamba module that captures both global geometric structures and local details, a surface-aware rendering mechanism that incorporates SDF constraints, and an adaptive ternary spiking neuron designed to improve training stability. Experiments on synthetic and real-world datasets demonstrate that DSMamba-NeRF achieves better rendering quality than existing SNN-based NeRF methods, particularly for thin structures and object boundaries, while maintaining low estimated computational energy costs. Ablation studies are also conducted to evaluate the effectiveness of the individual components.
Critical strengths
The paper addresses two specific limitations of existing SNN-based NeRF methods, as geometric fragmentation and floater artifacts. The proposed framework combines global-local geometric modeling, SDF-based surface constraints, and adaptive ternary spiking neurons to tackle these issues from different perspectives. These components are reasonably well motivated and form a coherent framework for improving reconstruction quality while preserving the efficiency advantages of SNNs.
The method consistently outperforms existing SNN-based NeRF baselines across synthetic and real-world datasets, with particularly noticeable improvements in thin structures and object boundaries. Beyond standard rendering metrics, the paper provides edge-region evaluations, qualitative comparisons, and ablation studies to support the effectiveness of the proposed approach. The reported energy estimates also suggest a favorable trade-off between rendering quality and computational cost.
Critical weaknesses
The state update in Eq. (1) resembles a conventional spiking recurrence with spike-dependent resetting. It is unclear what benefits specifically come from the Mamba formulation. Comparisons with simpler spiking recurrent or state-space models would help clarify its novelty.
The paper focuses on geometric fragmentation and floater artifacts, but the evaluation mainly relies on image-level metrics such as PSNR, SSIM, and LPIPS. Although qualitative geometry visualizations are provided, quantitative 3D reconstruction metrics are missing. Evaluations using Chamfer Distance, F-score, or surface accuracy would better support the claimed geometric improvements.
Questions for authors
-
The state update in Eq. (1) appears similar to a conventional spiking recurrence with spike-dependent resetting. What are the specific advantages of the proposed Mamba formulation? Could the authors compare it with simpler spiking recurrent or state-space models to demonstrate its effectiveness?
-
Since the paper aims to address geometric fragmentation and floater artifacts, could the authors provide quantitative 3D reconstruction metrics, such as Chamfer Distance, F-score, or surface accuracy, to further validate the claimed geometric improvements?
2 comments
W2: The paper focuses on geometric fragmentation and floater artifacts, but the evaluation mainly relies on image-level metrics such as PSNR, SSIM, and LPIPS. Although qualitative geometry visualizations are provided, quantitative 3D reconstruction metrics are missing. Evaluations using Chamfer Distance, F-score, or surface accuracy would better support the claimed geometric improvements.
A2: Thanks for your advice, that the image-level metrics alone cannot support the geometric claims. We added a quantitative 3D surface evaluation with Chamfer Distance (CD) and F score on Lego and Ship, considering the limited time (Appendix A.6.2, Table 10, and Figure 11).
Protocol: every surface is extracted on a 256³ grid in a common foreground domain (zero level set for the SDF, thresholds fixed before evaluation for density fields), and 100,000 points are sampled uniformly by surface area. CD is the symmetric unsquared Chamfer distance normalized by the ground-truth bounding box diagonal and multiplied by 10³. [email protected]% is the F score at a tolerance of 0.5% of that diagonal, in percent. All values are means over five runs.
| Scene | Method | PSNR↑ | SSIM↑ | LPIPS↓ | CD↓ | [email protected]%↑ |
|---|---|---|---|---|---|---|
| Lego | NeRF (ANN) | 31.39 | 0.959 | 0.022 | 2.47 | 88.14 |
| Lego | Spiking NeRF | 29.37 | 0.942 | 0.040 | 4.83 | 67.95 |
| Lego | Spik-NeRF (distillation) | 30.84 | 0.949 | 0.026 | 3.69 | 78.20 |
| Lego | DSMamba-NeRF | 31.13 | 0.953 | 0.025 | 2.78 | 85.57 |
| Ship | NeRF (ANN) | 29.39 | 0.872 | 0.088 | 3.63 | 78.19 |
| Ship | Spiking NeRF | 27.89 | 0.841 | 0.125 | 7.27 | 56.62 |
| Ship | Spik-NeRF (distillation) | 28.71 | 0.854 | 0.107 | 5.08 | 69.44 |
| Ship | DSMamba-NeRF | 29.01 | 0.863 | 0.097 | 3.77 | 76.62 |
The table is an excerpt of Table 10 in the Appendix, and bold marks the best SNN-based result. Compared with Spik-NeRF, DSMamba-NeRF lowers CD by 24.7% on Lego and 25.8% on Ship and raises F score by 7.37 and 7.18 points. Compared with Spiking NeRF, it lowers CD by 42.4% and 48.1% and raises F score by 17.62 and 20.00 points. The PSNR margins over Spik-NeRF on these two scenes are only 0.29 dB and 0.30 dB, so the surface metrics reveal a larger geometric gain than the image metrics indicate. F score responds to both defects, because floater artifacts lower precision and geometric fragmentation lowers recall. A gap to the ANN-based NeRF remains (2.57 and 1.57 points in F score), and we report it in the table. In the Appendix, the Figure 11 additionally shows the extracted surfaces on Chair, Ship, and Lego.
Q1: The state update in Eq. (1) appears similar to a conventional spiking recurrence with spike-dependent resetting. What are the specific advantages of the proposed Mamba formulation? Could the authors compare it with simpler spiking recurrent or state-space models to demonstrate its effectiveness?
A1: Thanks for the question. Please see our response to W1.
Q2: Since the paper aims to address geometric fragmentation and floater artifacts, could the authors provide quantitative 3D reconstruction metrics, such as Chamfer Distance, F-score, or surface accuracy, to further validate the claimed geometric improvements?
A2: Thanks for the question. Please see our response to W2.
Thanks for your advice again. If you have any other questions, please feel free to let us know.
Response to Reviewer bfVy: Mamba Formulation and Quantitative Geometry Evaluation
Thanks for your efforts in reviewing our paper and your recognition of our well-motivated and coherent framework, the consistent gains over existing SNN-based NeRF methods, and the edge-region evaluation and ablation studies. The response to your questions is given piece by piece as follows. All section, table, and figure numbers refer to the revised manuscript.
W1: The state update in Eq. (1) resembles a conventional spiking recurrence with spike-dependent resetting. It is unclear what benefits specifically come from the Mamba formulation. Comparisons with simpler spiking recurrent or state-space models would help clarify its novelty.
A1: We sincerely thank you for pointing out that the state update in Eq. (1) resembles a conventional spiking recurrence with spike-dependent resetting, and for suggesting comparisons with simpler spiking recurrent or state-space models to clarify the specific benefits and novelty of the Mamba formulation. The state update in Eq. (1) is a ternary spiking recurrence with spike-dependent reset, and our original text did not state clearly what is inherited from Mamba. We have revised the paper in two ways.
First, we clarified the formulation (Section 3.1, Appendix A.3, Appendix A.6.1, and Table 9). DSMamba keeps three elements of the selective state space model: the diagonal state recurrence, the linear scan cost, and a retention coefficient that changes along the sequence. It realizes this coefficient through the reset of the ternary neuron. Writing the reset as a gate gives a_k = α · 1[s_(k−1) = 0], so the retention switches between 0 and α according to the firing at the previous position and therefore follows the input accumulated since the last spike. This is a binary counterpart of the selective transition of Mamba: the gate is driven by the previous firing instead of a learned function of the current token, and the input write has a fixed gain. In return, the state update needs no multiplication beyond the leak, so the scan stays in the accumulate regime. Table 9 lists the correspondence:
Second, we added the comparison you suggested (Appendix A.6.6, Table 12). We replace the state update with three simpler recurrences under the same six-direction scan on Lego and Ship (T = 2, s = 2, γ = 0.5; means over three independent runs):
The results show three things. (1) Sequence memory matters: compared with Stateless, our unit improves PSNR by 0.86 dB on Lego and 0.82 dB on Ship, raises F score by 6.13 and 6.17 points, and lowers CD by 29.6% and 19.4%. (2) The reset gate matters: compared with FixedLeak at the same parameter count, our unit improves PSNR by 0.37 dB and 0.33 dB and raises F score by 2.63 and 2.74 points. (3) A heavier recurrence does not help: SpikingRNN is 0.23 dB and 0.17 dB lower in PSNR and 1.24 and 1.22 points lower in F score than ours, while its recurrent matrix adds a cost that is quadratic in the channel width.
The benefit of the formulation therefore comes from the reset-gated diagonal retention inside the directional scan, obtained at linear cost and with no multiplication beyond the leak. We have also corrected the sentence in Section 3.1 that described the gate as switching "according to the input".