- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents CAHI4D, an optimization-based framework for monocular 4D reconstruction of cross-age human interactions. The method targets the scale-depth ambiguity caused by age-dependent body morphology and uses validated interpersonal interactions to transfer geometric constraints from a reliably reconstructed participant to an underconstrained one. Its main components include Depth- and Interaction-Guided Geometric Anchoring (DIGA) for relative placement and scale estimation, age-aware shape fitting with Anny-SOMA, and Kinematic-Topology-Guided Interaction Correction (KTIC) for interaction-aware motion refinement. Experiments on Hi4D, 3DPW, and CMU toddler sequences show consistent improvements, with particularly large gains in relative adult-child geometry on the CMU subset.
Critical strengths
- The problem setting is an interesting and relatively underexplored problem of cross-age multi-person 4D reconstruction.
- The method achieves strong results, particularly on adult-child reconstruction, with useful ablations supporting the main components.
Critical weaknesses
- First of all, the high-level presentation of the paper is difficult to follow. Both the abstract and the introduction present numerous technical components before clearly defining the problem decomposition and the overall method logic. In particular, the paper does not clearly explain why the reconstruction problem is decomposed into geometry, shape, and motion stages, which specific failure mode each stage addresses, or why these stages must be performed in this order. As a result, key concepts such as the reference participant, interaction-guided placement, scale correction, shape fitting, and KTIC appear abruptly and are difficult to connect into a coherent pipeline.
- The motivation for the core scale-depth ambiguity is not sufficiently developed. Although this ambiguity appears to be the central problem addressed by CAHI4D, the introduction only briefly mentions it and does not clearly show how existing methods fail under cross-age morphology or why interaction-based geometric anchoring is necessary. The subsequent introduction of a “reliable depth reference” therefore feels abrupt rather than naturally derived from the problem analysis. The presentation is further complicated by the introduction of the “Anny–SOMA” representation without clearly stating whether it is an existing representation or a combination constructed in this work, nor why combining Anny and SOMA is necessary for the proposed pipeline.
- The method relies on interaction cues to correct inaccurate depth and placement, but these interaction hypotheses are only accepted after checking the current 3D geometry, including surface distance, normals, depth ordering, and temporal consistency. If the initialization is already substantially wrong, I am not convinced that the correct interaction can even pass these checks. In other words, the method may only work when the initial geometry is already reasonably close to the solution.
- Once DIGA fixes the geometry, shape fitting cannot revise the placement, and the motion stage only allows very limited root updates. This design may prevent later evidence from correcting mistakes made by earlier stages and could simply lock an incorrect geometric anchor into the final reconstruction.
- The interaction event in KTIC updates only one designated owner, while the other participant is detached. This is a strong assumption, especially for adult-adult interactions where both reconstructions may be inaccurate, and there is no obvious reason why only one person should absorb the correction.
- The scale correction still depends heavily on the quality of the initialization. DIGA estimates scale by preserving the projected extent before and after depth/placement refinement, and the resulting stature is then enforced during shape fitting. Therefore, if the initial body extent or morphology is already wrong, which is exactly plausible for occluded children, the final scale may simply inherit that error.
Questions for authors
- The author should carefully reorganize the high-level presentation of this paper, improving the readability and emphasizing the core challenges and motivation of the proposed method. The current presentation is really hard to follow.
- Could the authors perturb the initial depth/scale and report how interaction-admission recall and final reconstruction accuracy change?
- Could the authors provide the results of comparing the current sequential optimization with an alternating refinement that allows geometry to be revisited after shape or motion fitting?
- How robust is CAHI4D when the initialized body scale or phenotype is inaccurate?
I do think the problem studied is valuable and interesting, and the visualization results are visually pleasing. However, readability remains a major problem, which lowers my rating. Besides, the methodology is somewhat like an engineering composition of several rules that require a bunch of assumptions. These assumptions are not clearly discussed or listed in the paper, which raises my concerns about the method's applicability. I would really like to increase my score if the authors could provide more evidence to support their claim and design.
3 comments
Regarding the technical details, my concerns have been partially addressed. I appreciate the authors' clarifications and acknowledge the substantial improvements over VIMO initialization. However, I remain concerned about the sensitivity of the proposed framework to inaccurate initial geometric estimates, particularly regarding interaction admission and body scale correction. While Table 1 demonstrates overall reconstruction improvements, it does not directly evaluate the robustness of these mechanisms. Similarly, Figs. 7 and 8 mainly illustrate age-dependent body proportions rather than robustness to initialization errors. Since interaction admission depends on intermediate geometric estimates and the recovered stature is fixed during subsequent shape fitting, a sensitivity analysis with different initial depth, scale, or phenotype estimates would provide more convincing evidence of the framework's robustness.
Overall, I appreciate the authors' efforts and the additional clarifications and experimental results. I am willing to slightly increase my rating in recognition of these improvements, although I hope the authors can further address the remaining concerns to strengthen the manuscript.
Official Comment by Authors
Dear Reviewer oVHy, we hope that our paper revision and the above responses address your concerns. Please let us know your thoughts, and we are more than happy to answer any further questions.
First, I would appreciate it if the authors could provide a revised manuscript with the changes highlighted to facilitate the review.
I appreciate the authors' efforts to reorganize the Abstract and Introduction and clarify the motivation behind individual components. While the roles and motivations of these components are now clearer, I still find the high-level presentation somewhat fragmented. The revised manuscript presents geometry, shape, and motion reconstruction as largely separate challenges, followed by a sequential description of the corresponding modules. As a result, the proposed framework reads more like an engineering-oriented system that combines several task-specific solutions rather than a unified approach driven by a clear technical insight.
My main concern is that the paper does not sufficiently explain how these challenges are fundamentally connected, why they require a unified solution, or what motivates this particular system design. Although Table 6 provides empirical support for the optimization order, it does not fully establish the underlying rationale. Without a clearer connection between the identified challenges and the overall method design, the technical novelty of the framework remains difficult to appreciate.
As a suggestion, I believe the paper could benefit from a more unified narrative that emphasizes the connections and dependencies among geometry, shape, and motion reconstruction rather than presenting them as separate challenges. This would help readers better understand the motivation behind the overall framework and more clearly recognize its technical contributions.