- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2(+1)
Read review
Paper summary
This paper studies human motion reconstruction (HMR) from body-worn IMU sensor trackers under a configuration-agnostic setting: 3 compulsory trackers (always available) and 3 optional trackers (whose signals may occasionally be lost). To mitigate occasional signal loss, it proposes STANCE, a diffusion-based framework. It starts from a coarse pose prediction, calculates the per-joint confidence using available tracker measurements, and refines the poses through diffusion refinement. It also designs training-free guidance based on scene geometry to reduce scene penetration, but it does not show how to obtain this scene. Overall, the methodology design is not clearly structured and is questionable.
Critical strengths
The research tries to improve the robustness of IMU-based HMR and improve temporal consistency and accuracy during sensor signal loss. It is a meaningful research direction for real-world deployment.
The proposed method is claimed to support real-time Unity rendering.
Critical weaknesses
-
Mathematical symbols are not well organized: lower-case s_n^k, upper-case S^c, and u^k_m all stand for sensor measurements. H stands for both the future window size and the feature representation. Both n and m are used in timestamps. In Equation 5, the historical poses x are input to the model rather than \bar{x}. Please clarify whether you use GT history or predicted history. These misuses of symbols make the method difficult to comprehend.
-
Missing important details: How do you obtain y_floor for coordinate transformation? Moreover, FABRIK is undefined, and there is no reference. Do you use human limb lengths during IK? How do you obtain or estimate GT human limb lengths?
-
The geometric term on the reconstructed pose in L_geo is undefined.
-
The paper does not describe how the prior scene is constructed in Sec. 3.5. If it is not estimated from head observations, it raises fairness concerns since other methods do not have access to this prior scene.
Questions for authors
No
8 comments
Thank you for your valuable feedbacks.(Q2&Q3&Q4)
Q2: Missing details
is the height of the floor plane in the world frame and is a session constant rather than a per-frame quantity. In the live system it comes from the headset's room calibration, which places the floor at zero; on AMASS it is read from the capture. It enters only the origin of the local frame in Eq. (3), so what matters is that the same convention holds at training and at deployment, which calibration guarantees.
FABRIK is Forward And Backward Reaching Inverse Kinematics (Aristidou & Lasenby, 2011), a classical and widely used IK solver whose name we had taken to be common knowledge and therefore left unexpanded, which we agree is not appropriate for a general audience. The reference will be given in the revised paper.
The solve does use bone lengths, and they are an input rather than a quantity we estimate: on AMASS the per-sequence rest skeleton supplied with the dataset, and in the live system the calibrated avatar skeleton of the session. No limb length is inferred from the tracker readings, so the solve has nothing subject-specific to estimate at run time.
Q3: Definition of the Geometric Loss
We have now explicitly defined both terms. uses an MSE loss to measure the error between the confidence-gated target residual and the residual predicted by the denoiser, aggregated over all joints. is a weighted combination of position MSE, squared rotational-angle error, Huber loss, and cosine loss, evaluated on the reconstructed pose against the ground-truth pose . The two terms provide complementary supervision: supervises pose residuals, while explicitly constrains the geometric and rotational consistency of the reconstructed motion. The full set of components and their weights is given in the revised appendix.
Q4: Construction of the Prior Scene and Fairness
The scene is authored rather than estimated. We reconstruct the real furniture geometry from photographs and dimensional references, place it in Unity, and attach collision proxies whose signed distance fields (SDFs) provide the distance and gradient queried by the correction module. This design matches our target application: when motion is replayed in a virtual room, the room geometry is already available as part of the environment, making it an input rather than something that must be recovered from head observations. Estimating unknown scene geometry is a separate problem and is outside the scope of this work.
Importantly, our main quantitative comparisons do not give STANCE access to scene information unavailable to other methods. The evaluations in Tables 1–3 use AMASS under the A-P2 protocol, where no scene geometry is involved and the scene correction module is inactive. Thus, all reported accuracy, velocity, and jitter results are obtained using the same input information available to the baselines. Scene geometry is introduced only in the additional scene-consistency evaluation, where we compare STANCE with and without posterior correction under the same scene conditions. We therefore present scene consistency as an additional capability of STANCE, rather than as an advantage in the main benchmark comparisons.
Dear Reviewer dJdg,
Thank you again for the great efforts and valuable comments. We hope you find the response satisfactory. As the discussion phase is about to close, we are eagerly looking forward to hearing from you regarding any further feedback. We will be more than happy to address any additional concerns you may have.
Best,
STANCE Authors
Thank you for your valuable feedbacks.(Notice1&Q1)
We thank reviewer dJdg for the careful reading and for pointing out several aspects that require clarification.
Notice 1: Fundamental Clarification of the Input Modality
We would first like to clarify a fundamental misunderstanding in the review: STANCE does not use IMU signals at all. It operates exclusively on body-worn position trackers that provide positional observations, not inertial measurements. The three compulsory and three optional sensors described in the paper are all position trackers, with the optional trackers potentially becoming unavailable during motion. This distinction is fundamental, not merely terminological: IMU-based motion reconstruction relies on inertial signals, whereas STANCE addresses motion reconstruction from sparse and intermittently missing positional observations. Consequently, characterizing our work as IMU-based HMR misrepresents the input modality, the underlying problem setting, and the technical motivation of the proposed method. We respectfully ask that this distinction be taken into account when evaluating the paper.
Q1: Organization of Mathematical Symbols
Clarifications of Existing Notation. The three sensor symbols represent successive levels of the same data pipeline, rather than three names for the same quantity. Specifically, snk denotes the raw measurement from tracker k at frame n (Eq. 2). umk denotes the single-frame encoding derived from this measurement for the Predictor, incorporating frame-to-frame rotation and displacement (Eq. 4). Smc concatenates these encodings across the three core trackers at frame m, and the Predictor takes the window Sn−L:nc as input. Thus, these symbols represent three successive levels of the same data pipeline, from an individual tracker's raw measurement to its per-frame encoding and finally to the Predictor's windowed input.
The two time indices also have distinct meanings: n denotes the current frame being estimated, whereas m indexes individual frames within the input window n−L,…,n. This separate index is necessary because the encoding involves frame-to-frame differences at each position in the window, rather than only at the current frame.
Corrections in the Revised Manuscript. We acknowledge that reusing H for the prediction horizon and token matrices could cause ambiguity, as they were distinguished only by boldface. We have therefore renamed the token matrices as Zs, Zm, and Z, reserving H exclusively for the prediction horizon.
We have also corrected Eq. (5) and the corresponding denoiser conditioning in Sec. 3.4. Throughout the paper, x denotes the ground-truth pose, xˉ denotes the Predictor's prior prediction, and x^=xˉ+r^ denotes the reconstructed pose after residual refinement. Therefore, the historical input should consist of reconstructed poses, and Eq. (5) should use x^n−L:n−1 instead of xn−L:n−1. Accordingly, the denoiser conditioning in Sec. 3.4 is corrected to (x^n−L:n−1,xˉn:n+H).