- Rating
- 2(−1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper shows that changes in a Gaussian's position and normal-direction thickness have a greater impact on the rendered image at larger viewing angles, with the effect of thickness increasing more rapidly. In monocular video reconstruction, this imbalance can contribute to view-dependent reconstruction errors being incorrectly learned as geometry deformation over time. MoProGS mitigates this issue by reducing deformed Gaussians' normal-direction thickness at grazing incidence. Controlled studies validate the analysis.
Critical strengths
- The paper presents an interesting view-dependent approach supported by theoretical analysis.
- Controlled experiments show that the proposed method reduces view-specific fitting in the learned deformation.
Critical weaknesses
- The experimental evaluation could be further strengthened to better support the paper's claims (see Q1 and Q2 below).
- I highly recommend including video comparisons for a more comprehensive evaluation.
Questions for authors
- Could the authors compare their method with learned view-dependent splatting kernels [1], which pursue a similar goal, in the setting of static scene reconstruction without a deformation network?
- Since the fundamental question (L16–18) is not limited to dynamic scenes, excluding the deformation network would clarify the effect of the proposed approach.
- Could the authors quantify whether the adapters actually reduce coupling between the position and covariance branches, and show that the improvement comes from the reduced coupling rather than the increased model capacity?
- Could the authors clarify the Neu3D evaluation protocol and results?
- Why is the
flame salmonscene excluded, unlike evaluations in prior work such as 4D-GS? - PSNR and SSIM improve marginally from 32.18 to 32.27 dB and from 0.946 to 0.947, while LPIPS improves substantially, from 0.146 to 0.089, compared to FAGS. How can this discrepancy be explained?
- Could it be explained by the different number of Gaussians?
- Why is the
- Could the authors extend Table 12 and move it to the main paper?
- The table supports the camera–time leakage problem (L043–045). Since prior methods already use camera-blind deformation (L162), I suggest moving Fig. 6 to the appendix and placing Table 12 in the introduction (please cite the table in the text as well).
- Moreover, the table does not directly show whether the proposed method mitigates leakage under the same experimental setting. Extending Table 12 such as follows would better support the paper's main contribution. |Method|Time|Assigned|Recombined|Held-out view| |-|-|-|-|-| |w/o view-dependent approach|shared|32.980|-|xx.xxx| |w/o view-dependent approach|unique|34.117|31.214|xx.xxx| |w/ view-dependent approach|shared|xx.xxx|-|xx.xxx| |w/ view-dependent approach|unique|xx.xxx|xx.xxx|xx.xxx|
- This would help readers better understand the paper's motivation and contribution.
[1] Ding et al. "Learning View-Dependent Splatting Kernels." SIGGRAPH 2026.
7 comments
Q3: Clarify the Neu3D protocol and results. Why is Flame Salmon excluded? Why does LPIPS improve much more than PSNR and SSIM? Could it be the number of Gaussians?
-
Protocol. cam00 is held out for all 300 frames. We train on the remaining cameras at 1352 × 1014 with the released schedule.
-
Flame Salmon. The baseline rows of Tab. 2 are taken from FAGS, which reports the other five scenes. Flame Salmon is also the only sequence with 1,200 frames. We are training MoProGS on its first 300 frames under the same protocol and will post the result here.
-
LPIPS gap. It was a protocol mismatch on our side. Our LPIPS used AlexNet with inputs in [−1, 1], while the baseline rows come from a code base that evaluates with VGG on inputs in [0, 1]. Under one protocol MoProGS obtains 0.134 against 0.146 for FAGS, which is 8% lower (Tab. R4 in our response to Reviewer crMu). The LPIPS margin is then in line with the PSNR and SSIM margins. All three are smaller on Neu3D than on the monocular benchmarks, as the analysis predicts when many synchronized cameras constrain every state.
-
Number of Gaussians. It does not explain the gap, which came from the protocol. MoProGS leaves densification and pruning unchanged and uses 210k to 330k Gaussians per scene on Neu3D. Our FAGS re-implementation uses 220k to 340k on the same scenes.
Q4: Extend Tab. 12 to show whether the method mitigates leakage under the same setting, and move it to the main paper.
We ran the table exactly as proposed, with three seeds per row and the same initialization, training budget and evaluation (see Tab. R7 below). The “w/” rows are the full MoProGS model, with both the branch responses and the projection support.
Table R7. Frozen-scene intervention on Cook Spinach. PSNR in dB, mean ± s.d. over three seeds. Held-out views are the 12 rig cameras not used in training plus cam00.
| Method | Time | Assigned | Recombined | Held-out view |
|---|---|---|---|---|
| w/o view-dependent approach | shared | 33.34 ± 0.02 | n/a | 32.14 ± 0.05 |
| w/o view-dependent approach | unique | 34.51 ± 0.01 | 31.46 ± 0.02 | 31.24 ± 0.01 |
| w/ view-dependent approach, full MoProGS | shared | 33.09 ± 0.05 | n/a | 32.64 ± 0.06 |
| w/ view-dependent approach, full MoProGS | unique | 34.33 ± 0.12 | 31.87 ± 0.10 | 31.62 ± 0.10 |
-
MoProGS mitigates the leakage. Held-out PSNR rises by 0.50 ± 0.07 dB with shared times and by 0.38 ± 0.09 dB with unique times. PSNR on unseen camera-time recombinations rises by 0.41 ± 0.09 dB. The gap between assigned and recombined pairs narrows from 3.05 to 2.46 dB, a reduction of 19%. Every difference has the same sign in all three seeds.
-
The gain is not a better training fit. PSNR on the assigned pairs changes by −0.25 dB and −0.18 dB. The spurious temporal variation of the Gaussian centers falls from 0.055 to 0.034 scene units, in every seed.
-
Revision. As suggested, the table will be placed in Sec. 1 and cited next to the leakage motivation (L043–045), and Fig. 6 moves to the appendix. All four rows are retrained with three seeds, and this table replaces Tab. 12.
All changes above will be made in one revision of the manuscript once the remaining experiments are complete.
Thank you for the response. I will review it once the revisions are completed.
In the meantime, I have a few brief comments:
- This discrepancy in the LPIPS evaluation protocol raises concerns about the reliability of the experiments.
- Please carefully verify that all experiments have been conducted and evaluated fairly and correctly.
- It seems that the Tables R6 and R7 may have been swapped.
- If so, I wonder whether a PSNR over 40 dB is possible for the held-out (test) views of the
cook spinachscene.
- If so, I wonder whether a PSNR over 40 dB is possible for the held-out (test) views of the
- I could not find the stated "Held-out PSNR rises by 0.50 ± 0.07 dB" in the provided table.
We thank the reviewer for the positive assessment. Following the suggestions, we extended Tab. 12, measured the coupling between the two branches and unified the LPIPS protocol.
W1/Q1: Compare with learned view-dependent splatting kernels [1] in static scene reconstruction without a deformation network.
We agree that this comparison isolates the operator, and we are running it.
Analysis. The projection effect itself does not need a deformation network. On our controlled sheet, which has no time variable, current-incidence support changes the slope of the center-to-support ratio from −1.534 to −0.007. A constant contraction leaves it at −1.515 (Fig. 4, Tab. 7). In a static multi-view scene no temporal field can absorb a view-dependent residual. We therefore expect the attribution to become consistent there as well, with a smaller PSNR gain than under monocular dynamic capture.
Relation to [1]. [1] learns the kernel profile, decoded per view into a radially symmetric 2D kernel. MoProGS keeps the Gaussian kernel and changes only the extent along the normal axis, by an analytic factor of the current incidence. [1] makes every primitive more expressive and targets reconstruction quality. Our operator adds one scalar per scene and targets the attribution, so the two are complementary. We will add this discussion to Sec. 2.
Experiment. We apply our support operator to static 3DGS without any deformation network, on the benchmarks used in [1]. We will report PSNR next to the numbers of [1], together with the within-Gaussian attribution slope of Tab. 9 with the support on and off. We will post the results here as soon as the runs finish and add them to the paper.
W1/Q2: Do the adapters actually reduce coupling between the two branches? Does the improvement come from reduced coupling rather than increased capacity?
Yes to both. The adapters lower the coupling toward the chance level, and at equal capacity PSNR follows the coupling (see Tab. R6 below).
Table R6. Coupling between the position and covariance branches on Neu3D. Cook Spinach and Cut Roasted Beef, two seeds each. Chance is the level of random directions.
Coupling. We measure the median absolute cosine between the sensitivities of the position and covariance outputs to the shared temporal feature. Random directions give 0.071. Without adapters the coupling is 0.014 to 0.018 above this level, and with independent adapters 0.004 to 0.009. Sharing the same adapters raises it to 0.14 to 0.18.
Coupling or capacity. Sharing the same adapters between the two branches keeps the 33,024 parameters and the function class, and changes only the coupling. PSNR then drops by 0.37 ± 0.13 dB, in all four paired runs.
D-NeRF. Here the backbone ties both branches to one shared weight, and the decomposition unties them. The correlation between the two weights then falls from 1 to 0.58 on Hook. This is where Tab. 4 measures the 0.20 dB. A shared response with the same 2,570 extra parameters and depth stays 0.12 ± 0.03 dB below independent weights on Hook (Tab. R2 in our response to Reviewer 6q62).
Leakage test. In Tab. R7 the full model reaches a higher held-out PSNR with a lower training PSNR, which added capacity would not produce.
W2: Video comparisons are highly recommended.
We are preparing side-by-side videos on D-NeRF, HyperNeRF and Neu3D, including cameras that are never used in training. We will upload them to the supplementary material as soon as they are ready.