- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a coordinate sampling criterion for accelerating the training of INRs. Each observed coordinate is viewed as a local representative of the underlying target function. The authors define the Target-Neighborhood (TaN) mismatch as , and define TaN sensitivity as the worst-case first-order growth of this mismatch as . This leads to the closed-form expression , where is the current reconstruction residual and is the local Jacobian of the target signal. The target Jacobian is estimated once at initialization. During training, the static target Jacobian is combined with the evolving reconstruction residual to form coordinate-wise scores, which are subsequently mean-normalized, EMA-smoothed, transformed with a concentration parameter , and mixed with uniform exploration controlled by to obtain sampling probabilities. The experiments cover 24 Kodak images, four SDF shapes, and 2,620 LibriSpeech audio clips, with comparisons against seven baselines.
Critical strengths
-
Accelerating INR optimization under a limited coordinate budget is a reasonable and practically relevant problem. The proposed method is conceptually simple and computationally lightweight. In particular, the reported overhead is approximately 32 ms per active sampling update, substantially lower than that of NINT and EVOS.
-
The experimental evaluation shows good attention to fairness and coverage. Reported wall-clock times include scoring and sampling overhead, and the experiments span three modalities, seven sampling baselines, three random seeds, multiple network sizes, and multiple sampling ratios. The image-domain component ablations are informative, and the visualization of how the sampled coordinates evolve during training provides an intuitive illustration of the method's behavior.
Critical weaknesses
-
The proposed TaN sensitivity is , where is the current reconstruction error and captures the local structure of the target signal. The paper interprets this formulation as coupling static target structure with the dynamically evolving reconstruction state, which is a reasonable motivation. However, after abstracting away the TaN terminology, the proposed criterion appears closely related to combining hard-example mining with local target-gradient or edge information. The current experiments establish that both the reconstruction residual and the target Jacobian are useful, but they do not clearly establish that the specific projected coupling derived from TaN sensitivity is necessary.
-
The experiments are sufficient to demonstrate the core idea, but the overall experimental setup feels somewhat dated relative to current 2026 standards. For example, the 3D reconstruction results in Figure 4 are relatively coarse and do not demonstrate performance at the level of geometric fidelity now commonly expected in modern 3D representation tasks.
Questions for authors
-
I believe the paper should more directly justify the necessity of the specific projected coupling . In particular, it would be useful to include a simple baseline such as , and compare it directly against . Both criteria use the same dynamic residual and static target-structure information and should have comparable computational cost. Such a comparison would help determine whether the directional residual-Jacobian coupling introduced by TaN sensitivity provides benefits beyond a simpler residual-weighted local-gradient criterion.
-
Could the authors discuss cases in which both the reconstruction residual and the target Jacobian have large magnitude, but ? In such a case, the TaN sensitivity can be close to zero despite both the current reconstruction error and local target variation being large. Does this situation occur in practice, particularly for vector-valued signals such as RGB images? If so, how should the resulting low sampling priority be interpreted from the perspective of optimization utility?
-
Please also consider reporting PSNR for the audio reconstruction, or alternatively providing a more quantitative error visualization/heatmap.
3 comments
The rebuttal addressed my concerns. I remain slightly positive.
Thank You for the Positive Feedback
We sincerely thank Reviewer uHAK for the follow-up and for confirming that our response addressed your concerns. Your suggestions have substantially improved the paper, and we will actively engage in any further discussion during the discussion period.
Response to Reviewer uHAK: Projected Coupling, NeRF Evaluation, Near-Cancellation Analysis, and Audio Evaluation
We are grateful to the reviewer for the thorough and encouraging assessment. The analyses you suggested have substantially improved the paper, and we respond to each weakness and question in turn.
W1 & Q1 (residual-Jacobian projected coupling)
We agree that the criterion is related to combining hard-example mining with local target-gradient information. Yet its form is simple and mathematically motivated (Defs. 1–2, Prop. 1), yielding the projected coupling between the residual and the signal-local Jacobian. Following the suggestion, we have added the norm-product ablation (Table 6, w/o Proj.). Against it, STaNS reduces time to PSNR = 35 dB and SSIM = 0.9 by 7.34% and 17.12%, showing that the directional coupling across output channels brings benefits beyond the norm product.
W2 (new NeRF and INR backbone evaluations)
Beyond the SDF results, we have extended the evaluation to a modern, representative 3D task by adding NeRF reconstruction experiments with both quantitative and qualitative comparisons (Sec. 4.6, Table 5, Fig. 6). STaNS achieves the best results on all metrics and checkpoints, e.g., reducing LPIPS by 13.93% at 30 seconds and 15.56% at the 5,000th iteration over the strongest competing sampler, while preserving finer details in the rendered views.
We further evaluate STaNS on different INR backbones beyond SIREN, including PE-MLP, FINER, and WIRE (Appendix A.5), where STaNS reduces time-to-quality by up to 9.58%, 19.72%, and 16.71% over the strongest competing sampler, respectively.
Q2 (near-cancellation in the residual–Jacobian projection)
We analyze this case on Kodak in Appendix A.7, defining near-cancellation pixels as those whose residual and Jacobian norms are both in the upper quartile, while the alignment ratio ∥J⊤r∥/(∥J∥∥r∥) is below 0.05. According to empirical results:
(1) Occurrence. It does occur for RGB images but is rare, affecting at most 0.0215% of pixels and 0.0715% of the total squared error during training (Table 13).
(2) Sampling priority and optimization utility. With residual modulation and EMA smoothing, these pixels still receive a relatively high ranking under the implemented STaNS sampler: their median percentile rank is 61–65 under the raw TaN score and 81–92 under the final sampling weight. We further replace these near-cancellation scores with the norm-product score of the w/o Proj. variant in W1 & Q1, and reconstruction is barely affected, with time-to-quality changing by at most 1.64% (Table 14).
Q3 (audio PSNR and error visualization)
We have added PSNR to the audio evaluation in Table 3, where STaNS achieves the highest value at all five checkpoints, e.g., 1.28 dB above the strongest baseline at 5 seconds. We have also added waveform error visualizations in Appendix A.4: absolute error maps on five clips (Fig. 8), and the average RMSE over all 2,620 clips versus training time (Fig. 9), where STaNS achieves the lowest error at 5, 10, and 20 seconds.
Revisions. We have added (i) the norm-product ablation (Sec. 4.7, Table 6), (ii) NeRF reconstruction experiments (Sec. 4.6) and additional INR backbones (Appendix A.5), (iii) the near-cancellation analysis (Appendix A.7), and (iv) audio PSNR (Table 3) with waveform error visualizations (Appendix A.4). All changes are highlighted in the revised PDF.