- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
- RRA-Avatar reconstructs animatable Gaussian avatars from multi-view videos, allocating body-aligned and residual-surface representations according to body-prior support rather than garment semantics.
- It initializes residual Gaussians using SMPL-guided shell sampling, multi-view foreground evidence, and temporal fusion, and uses separate deformation heads for the two layers.
- A staged training mechanism coordinates supervision, gradient scaling, and Gaussian topology updates to reduce inter-layer competition. Experiments on three datasets and component ablations support improved reconstruction of loose garments and off-body structures.
Critical strengths
- The dual-layer representation improves the rendering of loose garments and off-body structures, preserving clearer boundaries and details in the qualitative comparisons. On DNA-Rendering, Off-LPIPS decreases from 0.3962 for SeqAvatar to 0.3452 (Fig. 3 and Table 1).
- The residual initialization offers a practical way to identify off-body structures from multi-view masks and fitted body models, without requiring garment templates, semantic clothing partitions, or direct 3D supervision. Temporal fusion helps filter out candidates with insufficient cross-frame support (Sec. 3.3).
- Coordinating supervision, gradient updates, and topology growth provides a clear mechanism for maintaining layer specialization during training. The ablations support its effectiveness: adding responsibility allocation to the model with residual discovery and separate deformation heads reduces LPIPS* from 27.62 to 22.98 (Table 3).
Critical weaknesses
- The paper discusses several layered avatar methods, such as LayGA, D3GA, and Gaussian Wardrobe, but does not include direct experimental comparisons with them. This limits the evidence that the proposed support-based partition and responsibility-allocation mechanism offer advantages over existing layered representations.
- The residual layer still undergoes SMPL-guided coarse deformation, although loose garments can move substantially differently from the underlying body. This may constrain the modeling of weakly body-coupled clothing motion, and the suitability of this deformation assumption for challenging loose garments is insufficiently validated (Sec. 3.2).
- The training configuration varies substantially across datasets: residual guidance lasts 5,000 iterations on DNA-Rendering but only 100 on the other two datasets, and its loss weight changes from 1.0 to 0.001. Without sensitivity analysis or clear selection guidelines, the tuning effort and reliability when training on new datasets remain unclear (Appendices A.3 and B.1).
Questions for authors
- Why are the layered or hybrid methods discussed in the paper, including LayGA, D3GA, Gaussian Wardrobe, MonoCloth, ReLoo, and FreeCloth, absent from the comparisons? Given available public implementations, could you include suitable baselines under a matched protocol?
- Despite separate local deformation heads, why do both layers use SMPL-guided coarse deformation? Could you justify this choice for loose garments and compare it with a more independent residual-layer deformation mechanism?
3 comments
Thank you for the detailed response and the additional experiments. With only about five hours left in the discussion period, I understand that running further experiments takes considerable time and effort. The sensitivity study and your analysis of SMPL-guided deformation address my questions about the residual-guidance settings and the role of the SMPL prior. I also understand why the limitations of the publicly available implementations and preprocessing pipelines make a fair comparison with existing layered methods difficult under the same protocol.
I had lowered my score to 2 because my questions were still open on the final day of the rebuttal period. After reading your response, I am restoring my original score of 3. Thank you for taking the time to address my concerns.
We are very pleased that our rebuttal has addressed your concerns. Sincerely thank you for your valuable time.
We thank the reviewer for the helpful comments.
[Layered baselines] We agree that direct comparisons with these layered methods would be informative. However, the public resources we inspected have input or implementation requirements that prevent direct evaluation under our matched RGB protocol.
We therefore report quantitative RGB comparisons under a matched evaluation protocol. We also recognize the contributions of the layered and hybrid approaches discussed above and explain their methodological relationship to RRA-Avatar in the related work (Sec. 2, p. 3, lines 127–139).
[SMPL-guided residual deformation] We agree that loose garments can move differently from the body. However, articulated SMPL skinning can still provide a useful coarse motion reference. To test this, we compared the full model with a root-only residual variant that retains global root rotation and translation and removes articulated skinning. Its deformation head predicts non-rigid motion in the root coordinate frame. The body layer, initialization, network capacity, input features, training budget, losses, and topology settings remain unchanged.
Under the same novel-view protocol on six DNA-Rendering subjects:
Table R1. Residual-layer deformation on DNA-Rendering.
Retaining articulated SMPL guidance improves PSNR by 0.35 dB and reduces LPIPS∗ and Off-LPIPS∗ by 5.9% and 3.8%. SMPL-guided skinning provides a coarse reference for global motion and first-order articulation, while the independent residual head learns clothing-specific deviations from this reference. Thus, sharing the coarse prior does not impose identical motion on the two layers.
[Sensitivity and parameter selection] We added a sensitivity analysis in Appendix C.11, summarized in Sec. 4.3. We sweep λR∈10−3,10−2,10−1,1 and halve or double the default guidance duration, varying one parameter at a time and keeping total training iterations fixed. Across three datasets, the largest within-dataset ranges are 0.07 dB PSNR, 0.0003 SSIM, 0.47 LPIPS∗, and 7.6 Off-LPIPS∗, indicating limited sensitivity over the tested ranges. Dataset-level defaults are fixed across subjects without test-metric tuning. For new datasets, the configurations in Appendix B.1 provide practical starting points: stronger residual supervision on DNA-Rendering (λR=1) and weaker supervision on I3D-Human and ZJU-MoCap (λR=10−3). We recommend assessing the extent and reliability of training-view residual evidence: stronger, longer guidance for large, consistent residual regions and weaker, shorter guidance for smaller or less reliable regions.
Table R3. Sensitivity to residual-guidance weight and duration (paper Table 15).