- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SplatFlux decodes per-frame Wan VAE latents into Gaussian scenes for reconstruction and conditional generation. It aggregates static Gaussians across frames and interpolates dynamic Gaussians using predicted velocities, allowing intermediate-time rendering without another network prediction. Training uses geometry, rendering, mask, and flow supervision. a fine-tuned Wan2.1 supplies generation latents.
Critical strengths
- The shared decoder connects reconstruction and generation through one representation. Independent frame encoding and generator adaptation make the latent interface explicit.
- NVIDIA Dynamic Scene PSNR reaches 21.56 versus NeoVerse's 18.83, with LPIPS of 0.1918 versus 0.2881 (Table 1). Six-view static reconstruction also improves over DA3, 22.17 versus 20.86 PSNR (Table 8).
- The ablations support the representation design: removing static-dynamic decoupling drops PSNR to 13.94; removing mask or flow supervision gives 18.41 or 18.62 (Table 5). These are substantial losses from the full model's 21.56.
Critical weaknesses
- Generation comparisons use different video backbones (Tables 3-4). Without an RGB-generation-then-reconstruction baseline using the same Wan model and samples, gains cannot be attributed to latent decoding. Appearance and motion scores alone do not establish better 4D geometry.
- DAVIS splits one captured sequence into input and evaluation frames, testing temporal reconstruction along that camera path rather than independently observed simultaneous viewpoints. DyCheck also pools held-out-camera and same-camera timestamps. Separate view/time results would better support arbitrary-view and arbitrary-time claims.
- Equation 4 combines dynamic Gaussians from adjacent frames without explaining competing primitives, occlusion, or visibility changes. Dynamic thresholds and voxel-aggregation settings are unspecified. Fast motion and wider temporal gaps would be informative stress tests for local linear interpolation.
Questions for authors
- With the same Wan model and samples, how does latent decoding compare with RGB generation followed by reconstruction, including geometry-sensitive metrics?
- How do results differ across held-out views, times, and joint view/time pairs? How are adjacent Gaussian sets combined when visibility changes?
- What are latency, throughput, memory, and Gaussian counts at matched resolutions and sequence lengths? Please include the dynamic threshold and aggregation settings.