- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper addresses stale intermediate features in cached neural rendering. It proposes refresh-supervised correction, where each full-network recomputation provides a supervision pair consisting of the transported cached feature and the newly computed feature. A lightweight correction state is then fitted from this pair and applied during subsequent reuse frames, while the main rendering network remains frozen. The paper studies three parallel readouts: affine, mixture, and spatial. Experiments show that the spatial variant performs best, improving fidelity while reducing latency and memory relative to the baseline.
Critical strengths
- The paper addresses an interesting and important problem: how to correct the errors caused by reusing stale features in a cached model.
- The proposed approach is well motivated and technically sound. It uses samples collected during refresh steps to perform online training, thereby guiding the correction of cached features.
Critical weaknesses
- The central insight requires stronger support. The paper does not provide direct evidence that corrections learned at refresh frames transfer reliably to reuse frames or that the online fitting converges consistently. Furthermore, The method relies heavily on motion-warped intermediate features, but provides limited analysis of when this transport is reliable and how transport errors affect correction, especially under occlusion, disocclusion, rapid motion, and long reuse intervals..
- The experimental evaluation is not fully convincing. Although the method substantially improves fidelity relative to the frozen full-network reference, its gains against ground truth are modest, raising questions about its practical perceptual benefits. Moreover, experiments are conducted on a fixed architecture and a limited number of scenes, so the method’s generalization to other models and more challenging visual changes remains unclear.
- The paper argues that the correction state and its online fitting are lightweight, but it does not provide a detailed runtime or memory breakdown explaining why RenderTTT-spatial is faster and uses less memory than fixed blending. Since peak memory includes temporary workspaces and benchmark tensors, and the appendix uses CUDA Graphs for the RAFT flow estimator in some configurations, detailed profiling under matched configurations is necessary to distinguish algorithmic improvements from systems-level effects.
- The presentation could be improved. The paper provides insufficient background for readers unfamiliar with cached neural rendering, and some figures convey limited quantitative information. The experimental section in particular would benefit from a clearer organization of the settings, baselines, and main conclusions.
Questions for authors
- The reviewer would like to know how reliably corrections learned at refresh frames transfer to subsequent reuse frames. Can the authors report residual correlation, error as a function of reuse age, or convergence across refresh updates?
- How does RenderTTT behave under different motion magnitudes, occlusion/disocclusion patterns, and longer reuse intervals?
- What explains the gap between the substantial improvements over the frozen full-network reference and the relatively modest gains against ground truth?
- Please clarify the method’s generality beyond the evaluated STSSNet configuration and limited set of scenes. How does it perform with other rendering architectures and scene types?
- It would be useful to provide detailed runtime and memory profiling under strictly matched configurations.
- From the reviewer’s perspective, affine, mixture, and spatial appear to be three parallel readout strategies, with spatial clearly delivering the strongest results and constituting the paper’s main contribution. What is the specific motivation and value of the affine and mixture variants? Are they intended as meaningful alternatives, diagnostic baselines, or steps toward the final formulation?