- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
VFOM-GS reconstructs dynamic smoke with a volumetric Gaussian density field and explicitly models light-side self-shadowing. Building on Vol3DGS ray-integrated optical thickness, it deposits finite-width Gaussian profiles into a truncated Fourier basis and uses per-pixel depth normalization (PDN) to adapt the encoded interval.
Critical strengths
-
The Fourier coefficients explicitly incorporate the optical mass and ray-dependent width of each Gaussian. This gives a motivated alternative to treating each occluder as an infinitely thin event, and connects self-shadowing to the reconstructed density instead of relying entirely on baked Gaussian colors.
-
The system demonstrates shadow-aware reconstruction, changing illumination, smoke/environment shadow interactions and a functioning Unreal Engine implementation. Table 3 reports lower tested render time and storage than the Niagara voxel configuration, showing a concrete potential application.
Critical weaknesses
-
The broad reconstruction comparison in Table 1 evaluates images under the training light. The quantitative novel-light evaluation in Table 2 primarily contrasts two training stages of the same VFOM renderer rather than competitive relightable Gaussian baselines. Shadow-aware refinement improves PSNR but worsens LPIPS in both shown lighting conditions. GauSmoke is discussed in the appendix but omitted from the main quantitative comparisons.
-
The first stage explicitly fits shadow-free target images, followed by a shadow-aware stage with frozen colors. This makes appearance/attenuation separation easier than in an uncontrolled real capture. The finite K=7 Fourier approximation and PDN are motivated by analytic curves and a procedural sandglass, but their errors under complex, highly overlapping smoke densities are not quantified against accurate optical-depth integration.
Questions for authors
Q1. Can the authors compare against a volumetric Gaussian smoke renderer with an alternative shadow calculation (and, where feasible, GauSmoke) using matched geometry, illumination conditions and available supervision, with quantitative novel-light metrics?
Q2: Can legacy FOM versus finite-width VFOM, each with and without PDN, be compared on the complete smoke reconstruction task rather than primarily isolated numerical or procedural examples?
Q3: How does the truncated Fourier transmittance compare to high-accuracy integration of the same Gaussian extinction field across optical depths, overlap counts, and Fourier orders? Could the authors discuss how camera-side compositing approximations interact with light-side attenuation during optimization, in relation to analytical volumetric Gaussian rendering work such as 3DGEER and EVER?
[1] 3dgeer: 3d gaussian rendering made exact and efficient for generic cameras.
[2] Ever: Exact volumetric ellipsoid rendering for real-time view synthesis.
Responses
We sincerely appreciate your time and feedback. Below, we clarify the points raised and describe the added evidence in the revised paper and supplementary material.
W1 — Evaluation scope and metric trade-offs: We agree that refinement improves PSNR but worsens LPIPS in both cases; SSIM slightly improves on the back-lit side but decreases on the light-facing side. Refining the shared extinction field may improve overall shadow intensity while altering local contrast and detail in camera-side rendering. This can reduce pixel-wise error without improving perceptual similarity, so we report a metric trade-off rather than gains across all measures.
Q1–Q2: Supplementary S2 (Table R1) adds a full smoke reconstruction comparison relevant to both questions, using no shadow modeling, VFOM without PDN, FOM+PDN, and VFOM+PDN on Explosion. Without shadow modeling, baked-in dark RGB remains dark when regions face the new light (red dashed boxes). Without PDN, inaccurate shadows hinder recovery of extinction coefficients. With FOM, thin-event encoding increases sharp noise (yellow solid boxes). With VFOM, finite-width encoding preserves Gaussian thickness and a fuller volumetric appearance. The full model gives the best reported PSNR, SSIM, and LPIPS.
Our main goal is compact, low-cost real-time rendering of volumetric assets; ScalarFlow provides a supplementary robustness test rather than our primary reconstruction benchmark. We match GauSmoke's 120 frames, five cameras, and 270×480 resolution, comparing against its published results because its implementation is unavailable (Table R2). With light directions assumed to align with camera views, we jointly optimize colors and the Gaussian field through VFOM using captured images, without paired shadow-free targets, additional lighting estimation, or real-data-specific model components. Despite lower PSNR than LagrangianSplats, ours has higher SSIM, lower LPIPS, and smaller storage, supporting robustness under this approximation.
Table R1
Table R2
Q3: Supplementary S4 (Figure S3) uses overlapping Gaussians with different optical thicknesses. Keeping each Gaussian field fixed, we compare FOM and VFOM transmittance curves and their errors against exact integration at K=3,7,11, testing both the shadow representation and Fourier order. VFOM already has a small discrepancy at K=7 in the tested cases, supporting our default choice; the reconstruction ablation in S2 uses K=3.
Separately, reconstruction PSNRs are close: 27.41 dB at K=3 in S2 and 28.20 dB for the K=7 light-facing result in Experiment 2 (Table 2), a modest 0.79 dB gap.
3DGEER [1] targets exact projection geometry but retains compositing approximations; EVER [2] exactly integrates emission–absorption for constant-density ellipsoids. Our camera pass uses analytic Gaussian line integrals, and VFOM analytically derives Fourier coefficients from Gaussian density profiles. Approximations remain in finite-order shadow reconstruction, depth-ordered color compositing, and lighting sampled at Gaussian centers.
Both passes share Gaussian parameters, so their errors can affect reconstruction. For example, a dark pixel can be fitted by darkening RGB or increasing light-path extinction. On Explosion, joint optimization does not reliably separate shadows from color. We therefore first fit geometry and colors from shadow-free images, then remove dark Gaussians, freeze colors, and refine the extinction field through VFOM using shadowed images. More accurate attenuation and compositing may further improve reconstruction and are valuable directions for future work.
Please see the supplementary material (pages 20–21) and appendix for further details, figures, and quantitative results.
References
[1] Z. Huang et al. 3DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Cameras. ICLR, 2026. https://arxiv.org/abs/2505.24053.
[2] A. Mai et al. EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis. arXiv:2410.01804, revised 2025. https://arxiv.org/abs/2410.01804.