- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a new pipeline, called SAGE, for compressing multi-view human captures. Eight views are sampled from the 48 captured views. These source views are encoded together with the camera parameters, poses, and masks, and transmitted by the sender. The receiver decodes the source data and uses a multi-view diffusion network to complete the missing views with generated ones. It then reconstructs a 3D Gaussian scene from both the decoded and the generated images. The main idea of the paper is to give more weight to the source views than to the generated ones (a higher selection frequency during optimization and higher weights in the loss). Another contribution is the use of “source-cycle predictability” to assign more bits to the source views whose neighboring views the generator struggles to recreate. The authors report a slight improvement over SOTA methods in terms of both reconstruction metrics and size.
Critical strengths
-
The tackled problem is well motivated. In this setting, 40 generated views compete with 8 source views. Under uniform sampling and equal weights, the generator’s errors will considerably degrade the reconstruction. However, in the proposed approach the source views get 0.59 of the expected supervision instead of (1/6).
-
The ablations reported in the main paper and the supplement are quite extensive. They also include some mixed and negative results.
Critical weaknesses
-
The novelty of this paper is incremental. It seems to me that the core mechanism of this approach is just the loss reweighting. In Table 8 (Supplement Materials), the "Coefficient matched" case yields the greatest improvement over the "Uniform" case in PSNR. It reaches 24.85 dB, compared with 24.89 dB for full anchoring. So “source anchoring” is essentially “weight real views more than pseudo-views.”
-
The paper shows that the generated RGB does not help at all. In Table 3, the "Source-only" experiment, which ignores generated RGB entirely, yields better PSNR and DISTS than the "Source anchoring".
-
Some paragraphs are very unclear and were very hard to understand on first reading.
-
It would be more convincing to compare against recent diffusion-assisted reconstruction methods under similar reconstruction budgets and priors. The paper cites some of these methods but does not provide direct comparisons.
Questions for authors
-
How does a uniform sampler with a tuned weight ratio (a sweep over λ_s/λ_g) compare with anchoring?
-
How sensitive are the reported gains to the choice and quality of the prior (Diffuman4D) ?
-
How would the approach extend to uncalibrated settings, dynamic scenes, or non-human objects?