- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents DynStream for feed-forward dynamic Gaussian reconstruction from unposed video streams. It processes incoming frames causally within temporal chunks, predicts keyframe-relative camera poses and metric scale, and integrates local Gaussian predictions into a global scene. Static content is accumulated, while dynamic content remains associated with individual observation times. Experiments report improved rendering quality across five benchmarks and camera tracking on long KITTI sequences without per-scene optimization.
Critical strengths
-
The framework combines camera estimation and renderable Gaussian reconstruction in a causal pipeline.
-
Experimental results report consistent rendering improvements across five real and synthetic benchmarks.
Critical weaknesses
-
The Gaussian-specific contribution beyond LongStream is unclear. The method adopts keyframe-relative pose estimation and metric-scale prediction from LongStream (Cheng et al., 2026), but does not clearly explain what new design enables consistent Gaussian reconstruction across chunks. Table 3 shows that separating dynamic content is useful, while Table 4 validates the relative-pose and scale components. These ablations do not examine whether the proposed fusion maintains consistent Gaussian geometry across chunk boundaries or improves temporal consistency. The claimed contribution of globally consistent, streaming Gaussian reconstruction therefore remains insufficiently supported.
-
The dynamic representation provides limited support for temporal coherence. In Eq. 5 and Section 3.3, dynamic Gaussians are associated with individual observation times, without an explicit motion model or cross-time association mechanism. This supports reconstruction at observed timestamps, but the paper does not explain how observations of the same moving surface are combined over time, particularly through occlusions. The distinction between maintaining temporally coherent dynamic geometry and storing separate time-specific reconstructions therefore remains unclear.
-
An important comparison with existing online dynamic Gaussian reconstruction is missing. StreamSplat (Wu et al., 2026) already performs feed-forward dynamic Gaussian reconstruction from uncalibrated video streams, but is neither discussed nor evaluated. This omission also makes the characterization of existing feed-forward Gaussian methods as offline too broad. Although its coordinate formulation differs from DynStream’s metric mapping, a comparison on shared reconstruction and rendering tasks, with consistent input and timing protocols, would help establish the advance over existing online methods.
Wu, Z., Yan, Q., Yi, X., Wang, L., & Liao, R. Streamsplat: Towards online dynamic 3d reconstruction from uncalibrated video streams. ICLR 2026.
-
The practical online efficiency needs stronger characterization. Table IV reports 315.5 ms per input frame even in the 100-chunk setting, corresponding to approximately 3.2 FPS. The formulation is causal, but the paper does not specify the inference chunk length, output latency at chunk boundaries, or hardware used for these measurements. Moreover, Appendix G acknowledges that the accumulated Gaussian scene continues to grow. The reported average runtimes therefore provide limited evidence for sustained processing of arbitrarily long streams; runtime, memory, and Gaussian-count profiles along the same sequence would better support this claim.
-
The rendering evaluation protocol is insufficiently specified. Table 1 reports results over 14 sampled frames per scene, while Appendix B does not explain how reconstruction inputs and held-out target views are separated. It is also unclear which scene state is used to render each target and whether later observations are available at that point. These details are particularly important because Eqs. 9–10 supervise reconstruction of the current input frame. Without a clear input–target and temporal protocol, the reported improvements are difficult to interpret as evidence of online novel-view synthesis.
Questions for authors
-
Could the authors clarify which Gaussian reconstruction and fusion components are new relative to LongStream, and provide evidence of their effect on geometric consistency across chunk boundaries?
-
Could the authors explain how observations of the same moving surface are connected across frames, particularly when it becomes occluded? A short sequence example showing how the dynamic representation evolves would be helpful.
-
Could the authors provide a comparison with StreamSplat (Wu et al., 2026) on shared reconstruction and rendering tasks using consistent input and timing protocols, and explain how the different coordinate formulations are handled?
-
Could the authors specify the hardware, inference chunk length, and when frame outputs become available? For one representative sequence, could they report per-frame runtime, peak memory, and Gaussian count as the stream grows?
-
Could the authors specify the input–target view and time splits for Table 1, including which observations are available when each target is rendered? Please also clarify whether target RGB images are excluded from reconstruction and how target camera poses are obtained.