- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Stab4D addresses dynamic video stabilization by reconstructing local 4D Gaussian fields over overlapping temporal windows and rendering them along a smoothed camera trajectory. The method combines primitive-wise spline motion with evidence-guided temporal lifespans. Contribution-Guided Depth assigns depth supervision to individual Gaussians using their alpha-compositing contributions, while stable-view tube supervision transfers neighboring RGB-D observations to nearby target views. An additional objective suppresses newly exposed contributions without reliable observational support. Evaluation includes real NUS videos and a seven-scene synthetic dynamic benchmark with shared oracle geometry and stabilized target trajectories. The reported results show improvements in stable-view PSNR and SSIM, although perceptual quality metrics exhibit trade-offs.
Critical strengths
- The controlled evaluation isolates a consequential source of error. Providing reconstruction baselines with the same camera parameters, depth, and stabilized target trajectory helps separate representation quality from geometry estimation and trajectory smoothing. Reporting both raw-view and stable-view reconstruction quality directly tests whether fitting observed frames transfers to the views required for stabilization.
- The CDepth ablation provides targeted empirical evidence. In Table 3, CDepth achieves a stable-view PSNR of 31.925 dB, compared with 30.487 dB for rendered-depth supervision, while raw-view PSNR remains essentially unchanged. This suggests that the proposed geometric refinement can improve nearby-view rendering without simply improving the fit to the input frames.
Critical weaknesses
The paper should include comparisons with more dynamic Gaussian reconstruction methods, such as Temporal Gaussian Hierarchy[1], which uses a multiscale temporal representation of 4D Gaussians for dynamic reconstruction.
[1] Xu Z, Xu Y, Yu Z, et al. Representing long volumetric video with temporal gaussian hierarchy[J]. ACM Transactions on Graphics (TOG), 2024, 43(6): 1-18.
Questions for authors
- During reconstruction, the video is divided into multiple windows, and a local 4D Gaussian representation is reconstructed within each window. Could this affect reconstruction speed? The method should be compared with global 4D Gaussian reconstruction in terms of both reconstruction speed and rendering quality metrics.
- How is Gaussian overlap or stacking handled where local 4D Gaussian representations from different windows are stitched together? The 4D Gaussian field in Figure 2 appears to contain noticeable stitching seams. These overlapping Gaussians could produce floaters in novel views.