- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents S²4D, a framework for streaming dynamic scene reconstruction and novel-view synthesis from sparse synchronized, calibrated cameras. Building on IGS, the method uses pretrained optical-flow features, geometry-conditioned feature modulation, and 3D anchors to predict per-Gaussian translation and rotation. Its sparse-view adaptations include visibility–depth weighted feature fusion, a Sparse-view Flow Consistency (SFC) training loss, and sparse-view Gaussian refinement. Periodic refinement updates geometry and appearance while bounding the number of Gaussian primitives.
Critical strengths
-
Relevant problem setting. Combining sparse-camera capture, causal reconstruction, and transferable motion prediction addresses a meaningful practical challenge in dynamic novel-view synthesis.
-
Evidence of transfer. The model achieves the best reported PSNR and SSIM on ENeRF and PKU-MVHumans without retraining the motion network. Separate held-out N3DV results strengthen the evaluation.
-
Useful component analysis. Removing weighted fusion or SFC reduces PSNR by 1.15 and 0.67 dB, respectively. The bounded-refinement ablation also demonstrates substantial storage savings.
Critical weaknesses
-
Limited methodological novelty beyond IGS. Most of the architecture and streaming strategy are inherited, including flow-based encoding, geometry modulation, anchors, Transformer processing, interpolation, and bounded refinement. The contribution primarily consists of sparse-view adaptations. Stronger controlled evidence is needed to establish their significance independently of backbone and refinement changes.
-
Approximate cross-view motion regularization. SFC does not model general depth-changing motion, and the feature-fusion mask does not resolve occlusion. These limitations are especially relevant to the sparse-view setting, where geometric ambiguity is substantial.
-
Incomplete attribution of performance gains. The reported comparisons do not fully separate the effects of WAFT, weighted fusion, SFC, the refinement rasterizer, and optimization settings. Consequently, the source of the improvement over IGS remains insufficiently isolated.
Questions for authors
-
Can you provide a controlled IGS comparison that incrementally adds WAFT, weighted fusion, SFC, and the refinement rasterizer while keeping resolution, initialization, training data, and optimization settings fixed?
-
How does SFC behave when motion substantially changes source-camera depth? Would using the available target-frame depth improve the constraint, and how sensitive are the results to depth errors?
-
How frequently do occluded anchors receive misleading features under the projection-validity mask? Have you compared against depth-based occlusion rejection?
-
Can you report initialization time, propagation-only time, refinement-frame latency, and peak GPU memory on specified evaluation hardware?
-
How sensitive is performance to camera baseline and placement when the number of input cameras is fixed? Can the camera-count experiment also use a common set of evaluation views?
-
22Does weighted fusion and SFC improve performance consistently on held-out and cross-domain scenes, rather than only on the six-scene N3DV aggregate?