- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes S²Human, a pose-free 3D human reconstruction framework combining SMPL-X priors with VGGT-based stereo matching to generate high-quality 3D Gaussian humans without pre-calibrated camera extrinsics. It introduces a multi-view SMPL-X fusion module and a Posemap Adapter to enhance reconstruction quality. Experiments on THuman2.0 and Twindom demonstrate competitive performance against pose-aware methods, supported by ablation and robustness studies.
Critical strengths
- The paper introduces a pose-free 3D human reconstruction framework that eliminates the need for pre-calibrated camera extrinsics, potentially improving its flexibility and practicality in real-world scenarios.
- The proposed Posemap Adapter integrates structured SMPL-X human priors into the stereo matching network through intra-view and inter-view attention, improving rendering quality.
Critical weaknesses
- The Posemap Adapter provides only a modest improvement in PSNR (0.25 dB). Moreover, Table 4 does not report the geometric error of the full model, making it difficult to verify the claimed improvement in geometric accuracy.
- The proposed visibility-aware weighted fusion strategy for multi-view SMPL-X estimation is conceptually similar to the joint-wise view weighting strategy used in MUC (Zhu et al., 2025). The paper does not sufficiently clarify the novelty of this strategy compared to existing methods.
Zhu, Y., Wang, S., Xu, M., et al. (2025). MUC: Mixture of Uncalibrated Cameras for Robust 3D Human Body Reconstruction. Proceedings of the AAAI Conference on Artificial Intelligence, 39(10), 11040–11048.
Questions for authors
- Since VGGT can already predict camera extrinsics and 3D point maps, could combining VGGT-estimated camera parameters with existing pose-aware 3DGS human reconstruction methods achieve comparable performance to S²Human?
- Why is Tri-posemap preferred over alternative representations of SMPL-X human priors? What evidence supports the effectiveness of this design choice?
- In Table 5, the two settings with a 60° FOV show significantly different results (27.61 vs. 25.93 PSNR). Could the authors clarify the differences in camera configurations between these two settings and explain the performance gap?
- Given the emphasis on practical applications without pre-calibrated camera extrinsics, could the authors clarify whether the method has been evaluated on real-world multi-camera captures and what evidence supports its robustness in such scenarios?
5 comments
Responses to the Additional Questions
Responses to the Additional Questions
Q1. Could VGGT-estimated camera parameters be combined with existing pose-aware 3DGS human reconstruction methods?
Directly combining VGGT-estimated camera poses with existing pose-aware 3DGS human reconstruction methods faces a fundamental challenge of scale inconsistency.
VGGT predicts camera parameters in a normalized geometric scale, which is not guaranteed to match the scale and coordinate conventions used to train existing pose-aware human reconstruction networks. Directly substituting these estimated camera parameters can therefore introduce inconsistent geometric projections and degrade reconstruction quality, particularly for methods that rely on calibrated camera configurations.
In contrast, S²Human explicitly encodes the SMPL-X surface coordinates in Tri-posemap, providing a human-specific geometric scale reference that is integrated into the stereo matching network. This enables the network to incorporate human structural and scale information during reconstruction, alleviating the scale inconsistency associated with directly transferring independently estimated camera parameters to a pose-aware reconstruction pipeline.
Therefore, the suggested combination is not a direct plug-and-play alternative under the existing model configurations.
Q2. Why is Tri-posemap preferred over alternative SMPL-X prior representations?
Tri-posemap provides a dense, spatially aligned representation of human structura l priors that can be directly integrated with stereo matching features Li et al. (2024); Guo et al. (2025). Its three coordinate channels encode the 3D positions of the SMPL-X surface, while the additional channel describes the overlap between the projected SMPL-X body and the actual clothed human region. Compared with global SMPL-X parameters or sparse joint coordinates, this representation provides explicit spatial correspondence with image features.
Moreover, its pixel-aligned structure facilitates integration through the Posemap Adapter. The ablation results in Table 4 demonstrate the effectiveness of this human-prior representation and its integration mechanism.
Li, Z., Zheng, Z., Wang, L., & Liu, Y. (2024). Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 19711–19722).
Guo, C., Li, J., Kant, Y., Sheikh, Y., Saito, S., & Cao, C. (2025). Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Prior. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 5559–5570).
Q3. Why do the two 60° FOV settings in Table 5 produce different results?
Although both settings use a 60° FOV, they correspond to different camera configurations. The 60° (original) setting follows the original multi-view experiment in Table 1, whereas the 60° setting belongs to the intrinsic robustness experiment.
As described in Section 4.3.3, the camera-to-subject distances are adjusted in the robustness experiment to maintain approximately consistent human image footprints across different FOVs. Consequently, the adjusted 60° setting has a different camera-to-subject distance and human image coverage from the original setting, resulting in different rendering evaluation conditions and contributing to the observed PSNR difference.
Q4. Evaluation on Real-World Multi-View Captures.
To evaluate our method on real-world multi-camera captures and to provide evidence supporting its robustness in such scenarios, we have evaluated S²Human using real-world multi-view images captured with a consumer smartphone. The images are captured from multiple viewpoints without pre-calibrated camera extrinsics. Using these captured images as input, we reconstruct the 3D human representation and render intermediate viewpoints between the input views for qualitative evaluation. As shown in the video in the supplementary materials, these results provide a qualitative assessment of the reconstruction quality and novel-view synthesis capability of S²Human under real-world consumer-camera capture conditions, further demonstrating its practical applicability beyond synthetic multi-view datasets.
We thank the reviewer again for the constructive feedback.
Two Remaining Questions
Thank you for the authors' detailed response, which has addressed most of my concerns. However, I still have two remaining questions.
First, I wonder whether MUC's Joint Reweighting Network could be directly integrated into your framework to replace the proposed visibility-aware weighting strategy. I would like to see a direct comparison under the same experimental settings to better understand the advantages of your method.
Second, could the authors provide a direct comparison between Tri-posemap and other SMPL-X prior representations, such as global SMPL-X parameters or sparse joint coordinates? I think such a comparison would help demonstrate why Tri-posemap is a better choice.
If the authors can adequately address these two concerns with convincing experimental evidence, I would be willing to reconsider and potentially increase my rating.
We sincerely thank the reviewer for the constructive comments and valuable suggestions. We would like to provide the following clarifications and additional experimental evidence.
W1. Reconstruction Improvement and Geometric Accuracy
The geometric error of the full model was not reported in Table 4 because the scale of the estimated SMPL-X may differ from the ground truth, making direct point-wise distance comparisons unreliable.
Inspired by the reviewer's suggestion and scale-aligned evaluation protocols commonly used in depth estimation, we have conducted an additional geometric evaluation by aligning the scale and translation of the predicted first-stage point clouds with the ground truth before computing the L2 distance. The results are shown in the following table.
Geometric Error Results
\hline \text{Method} &\text{PSNR}\uparrow &\text{SSIM}\uparrow &\text{LPIPS}\downarrow &\text{L2 Distance(cm)}\downarrow \\\\ \hline \text{w/o adapter} & 25.68 & 0.9268 & 0.0893 & 2.27 \\\\ \text{full method} & 25.93 & 0.9287 & 0.0888 & \textcolor{blue}{1.73} \\\\ \text{full method(GT SMPL-X)} &\mathbf{26.54} &\mathbf{0.9331} &\mathbf{0.0834} &\mathbf{1.27}\\\\ \hline \end{array}$$ The resulting geometric error of the full model is 1.73 cm, which lies between the w/o adapter baseline (2.27 cm) and the full model using ground-truth SMPL-X (1.27 cm) reported in Table 4. This result is consistent with our conclusion that incorporating human structural priors improves geometric prediction, while more accurate SMPL-X priors provide further benefits. The additional geometric evaluation also complements the rendering-quality improvements reported in our ablation study. **W2. Differences Between Our Visibility-Aware Fusion and MUC** We thank the reviewer for highlighting MUC. Both methods employ weighted multi-view fusion to improve SMPL-X estimation, but our method adopts a much more lightweight weighting mechanism. MUC employs a learned Joint Reweighting Network to predict view-dependent joint weights from feature tokens and estimated camera parameters, guided by a joint-distance distribution loss. In contrast, our method directly determines joint visibility through 3D ray-mesh occlusion checks and 2D image-boundary checks, using the resulting explicit visibility information to compute fusion weights. Unlike MUC, our weighting strategy does not require an additional learned reweighting network or a distance-distribution-based training objective. Therefore, our contribution in SMPL-X fusion lies in adopting an explicit, geometry-based visibility criterion rather than learning joint reliability weights. The effectiveness of this strategy is supported by the SMPL-X estimation results in Table 3.