- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents CAGE-GS, a feed-forward framework for human 3D Gaussian reconstruction from sparse calibrated views. Its main contributions are Camera-Aware Warp Refinement (CAWR), which iteratively improves depth estimation, and Projection-Aware Attention (PAA), which enhances geometrically consistent cross-view feature aggregation. Experiments demonstrate improved reconstruction quality and generalization to unseen human subjects and different datasets without per-subject optimization.
Critical strengths
-
Improved Reconstruction Quality: CAGE-GS effectively reduces 3DGS artifacts around self-occluded body regions and produces sharper facial, hand, and clothing details. These improvements are particularly valuable for sparse-view human reconstruction, where geometric ambiguity often causes visible distortions.
-
Generalizable Sparse-View Reconstruction: The framework enables feed-forward reconstruction of unseen human subjects without requiring parametric body templates or ground-truth depth. The reported cross-dataset results further demonstrate promising generalization across different human datasets.
Critical weaknesses
- Dependence on Accurate Camera Calibration: Both CAWR and PAA rely on calibrated camera poses, but the paper does not evaluate robustness to pose errors or synchronization inaccuracies, raising concerns about practical applicability.
Questions for authors
- Choice of VGGT Backbone:
-
Since CAGE-GS uses known camera poses rather than VGGT's predicted poses, what motivates the choice of VGGT over alternative geometry foundation models such as Pi³ or Depth Anything 3?
-
Could CAWR and PAA operate with DINOv2 features and Depth Anything estimates, similar to geometry-guided reconstruction frameworks such as GeoLRM (NeurIPS 2024)? How much of the improvement depends on VGGT rather than the proposed modules?
-
If VGGT's predicted camera poses differ significantly from the provided calibrated poses, how is geometric consistency between the predicted depth and known camera geometry ensured?
-
Computational Efficiency: CAGE-GS requires 467.11 ms per reconstruction under the four-view setting. What are the individual runtime costs of VGGT, CAWR, PAA, and Gaussian prediction? Which component constitutes the primary computational bottleneck, and how does inference time scale with the number of input views?
-
The cross-dataset evaluation in Appendix Table 6 provides important evidence supporting the paper's generalization claim. I suggest moving these results to the main paper, clearly distinguishing cross-subject reconstruction from cross-dataset generalization.
Response to Reviewer PEUx
We thank the reviewer for recognizing our reconstruction quality and cross-dataset generalization. We provide additional experiments and clarifications on backbone choice, camera calibration, runtime, and generalization, with corresponding updates incorporated into the revised manuscript and appendix.
Re: Geometry Backbone Choice and Generality (Q1).
We select VGGT for its depth initialization and geometry-aware multi-view features, rather than its camera prediction capability, as calibrated cameras are available in our setting. Importantly, CAWR and PAA refine geometry and aggregate cross-view features through camera-grounded projections, without relying on VGGT-specific representations. To examine whether our gains depend on VGGT, we replace its depth and features with DA3-LARGE-1.1 and compare a frozen-backbone Gaussian baseline against our full pipeline. Table 1 shows substantial PSNR improvements with both VGGT (+8.32 dB) and DA3 (+7.35 dB), demonstrating consistent architectural benefits across different geometry backbones.
Table 1. Backbone and architecture comparison.
Re: Camera Calibration and Depth Consistency (W1/Q1).
Following prior human reconstruction methods (e.g., GHG, RoGSplat, and GHGS-MVSC), we use calibrated cameras for fair comparison. To assess calibration dependence, we replace them with VGGT-predicted reference cameras and jointly train the camera head. As shown in Table 2, our method achieves 27.24 dB PSNR with predicted cameras, demonstrating its feasibility under estimated camera geometry. Regarding depth–camera consistency, CAWR iteratively updates cross-view correspondences under the adopted camera parameters and refines depth accordingly, promoting consistency between the estimated geometry and camera projections.
Table 2. Comparison of calibrated and VGGT-predicted reference cameras.
Re: Runtime Breakdown and View-Count Scaling (Q2).
We profile inference with 2–5 input views on an RTX 4090 at 512×512 (FP16, batch size 1), using 100 samples, 20 warm-up runs, and three measurement passes. The repeated four-view latency is 466.92 ms, consistent with the reported 467.11 ms.
Table 3 reports the component-wise runtime and view-count scaling. At four views, PAA accounts for 207.85 ms (44.5% of total latency), followed by VGGT at 185.84 ms (39.8%). Across 2–5 views, the largest runtime contributor shifts from VGGT to PAA, reflecting the increasing cost of cross-view feature aggregation. End-to-end latency increases from 198.88 to 655.00 ms, while peak memory grows from 5.00 to 6.97 GiB. Component timings are measured using CUDA Events, whereas end-to-end latency is independently measured with GPU synchronization.
Table 3. Inference efficiency across input-view counts. PAA includes four feature-level calls.
Re: Cross-Subject and Cross-Dataset Generalization (Q3).
We thank the reviewer for this suggestion. In the revised manuscript, we have moved Appendix Table 6 to the main paper and explicitly distinguished cross-subject generalization (unseen identities within the training dataset) from cross-dataset generalization (THuman2.0-trained models evaluated on 2K2K/HuMMan without fine-tuning).