- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a framework for optimizing sampling correlations for neural field fitting. Unlike prior sampling approaches designed for numerical integration, the proposed method optimizes sampling patterns based on the reconstruction quality of the resulting neural field. To do so, sampling correlations are compactly parameterized via radial power spectra and explored using Bayesian optimization. The results show improvements over several sampling baselines, particularly under limited sampling budgets. The authors further demonstrate that patterns optimized on inexpensive proxy signals can transfer to more computationally expensive tasks.
Critical strengths
-
The paper investigates a relatively underexplored aspect of neural field training, establishing a meaningful connection between sampling theory and neural field optimization. The formulation is well-motivated and the proposed spectral parameterization provides a compact search space for optimizing sampling correlations.
-
The method improves neural field reconstruction performance over existing sampling strategies across 2D and 3D tasks. The authors also demonstrate that optimized sampling patterns transfer across signals, including to computationally expensive rendering and geometry processing tasks.
Critical weaknesses
- Although the proposed method generally improves performance, its gains over strong baselines such as GBN are often relatively modest. Given the additional cost of Bayesian optimization and pattern realization, it remains unclear whether these improvements justify the computational overhead compared to existing sampling strategies that require no task-specific optimization.
Questions for authors
-
Could the authors provide a breakdown of the computational cost of each stage (e.g. BO, realization, and neural field fitting) and quantify the additional overhead relative to standard neural fitting?
-
Appendix G shows that different realization losses can produce different anisotropic patterns despite matching similar radial spectra. How sensitive is downstream reconstruction performance to these choices, and does the realization optimizer also affect the resulting patterns?
-
How would the comparison with GBN change if the neural field training hyperparameters were tuned separately for each sampling strategy, rather than using a shared configuration?
3 comments
I thank the authors for their detailed rebuttal and additional experiments.
However, my main concern remains regarding the overall significance of the contribution. While the proposed framework is interesting and the improvements over GBN appear statistically consistent, their magnitude is relatively modest. Given that existing sampling strategies already achieve competitive performance without neural field fitting-aware optimization, I remain unconvinced whether the proposed approach represents a sufficiently substantial advance over these methods.
While I find the work technically sound, I am not fully convinced that the demonstrated benefits justify the additional optimization framework. Therefore, I will maintain my original rating.
Thank you for engaging with our rebuttal, and for confirming that the work is technically sound and that the improvements are statistically consistent. We would add that these gains come at no cost to the user. The optimized patterns are fixed point sets, used exactly like GBN, and in 10 of the 11 tested settings they improve on GBN for 13 or 14 of the 14 test signals. Together with the finding that integration-optimal patterns are not fitting-optimal, we believe this makes optimized sampling correlations a useful tool for neural field fitting.
Weakness/ Question 1
Weakness: Modest improvement over GBN
Question: Cost breakdown
Question 2
We evaluate how patterns realized from different losses affect the reconstruction quality (LDR, AAPE).
L1 outperforms L2 consistently, and weighted L1 achieves the best PSNR in 5 out of 6 budgets. The results indicate that different realization losses lead to different sampling patterns (as reflected in their full-dimensional spectra), hence different reconstruction performance.
We evaluate how patterns realized from different optimizers affect the reconstruction quality (LDR, AAPE, weighted L1 loss).
We notice that different optimization algorithms produce nearly identical reconstruction performance, indicating robustness with respect to the choice of the optimizer.
Question 3
We swept the learning rate, the most sensitive training hyperparameter, independently for both methods (LDR, AAPE, 65K samples).
Both methods peak at the same learning rate, the one used in the paper, so tuning each method separately leaves our comparison unchanged. More importantly, our advantage is nearly constant (0.19–0.23 dB) at every learning rate where training converges (at 1e-2, both diverge). The gain comes from the sampling pattern itself, not from a particular training configuration. This holds even though the pattern was optimized at a single learning rate.