- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies coordinate-level training difficulty in INRs using reconstruction-error trajectories. It examines how difficulty varies across random seeds, target-signal properties, and representations, and proposes recent-difficulty sampling to prioritize coordinates using a bounded error history. Experiments on 50 images and 50 audio signals across four architectures show that recent-history sampling improves global reconstruction over uniform sampling under fixed-step budgets, although gains over existing adaptive samplers and under equal-time budgets are not consistent.
Critical strengths
- Informative coordinate-level perspective on INR training. Tracking per-coordinate error trajectories reveals differences in learning behavior that final global reconstruction metrics obscure. The analysis across architectures and random seeds provides useful evidence that difficulty reflects both signal properties and representation choices, making this perspective a worthwhile contribution to understanding INR optimization.
Critical weaknesses
- The proposed sampling method does not yet establish a robust practical advantage. RDS turns the coordinate-level observations into a fixed-window error estimator, but its distinction from EMA is primarily the weighting of past errors. Although the 128-step window is selected on a separate development set, performance varies with the history length, and the paper provides limited guidance for choosing it under different training conditions. RDS neither consistently outperforms EMA and existing samplers nor retains its fixed-step gains under equal-time comparisons. Consequently, the evidence is stronger for an interesting diagnostic perspective than for a reliably better optimization method.
Questions for authors
-
Temporal weighting and robustness. When EMA and window-based sampling receive comparable hyperparameter-tuning budgets, does RDS retain an advantage in global reconstruction quality on held-out signals? What evidence distinguishes the benefit of a bounded window from simply choosing an appropriate effective memory length?
-
Applicability to indirect supervision. Does the method require directly observed targets at each sampled coordinate? For tasks such as NeRF, could difficulty instead be defined using rendered ray-level errors, and which conclusions from the coordinate-level analysis would remain applicable?
-
Training horizon. Do the global reconstruction gains persist beyond the 640-step sampling protocol? Please clarify whether longer-run results are available and whether RDS improves the eventual reconstruction quality or primarily changes early training behavior.
-
Value of training-history information. Given that target-only descriptors explain a substantial fraction of coordinate difficulty, have you compared RDS with sampling based on simple target statistics, such as image gradients or local audio energy? Such a comparison would help establish the additional value of tracking training errors.