- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents a motion reconstruction method using Mamba blocks to process IMU and UWB sensors. IMU-based mocap suffers from drift due to its inertial nature, therefore, the authors use UWB sensors to compute the distance between sensors and correct the drift from the IMUs. The main contributions are the prediction of the user shape (body segments and SMPL shape parameters), and the Continuous Unified Fusion (CUF) module. The paper is evaluated in two mocap datasets (with synthetic IMU and UWB data) and one dataset with real IMU and UWB data.
Critical strengths
- The topic addressed in this paper is interesting and of relevance to obtain consumer-grade reliable mocap. Fusing UWB sensors with IMUs is a promising research direction as demonstrated by previous research.
Critical weaknesses
- Limited technical novelty:
The proposed approach is very similar to existing literature in IMU motion reconstruction, and some design choices are similar to previous works already using IMU+UWB sensors. There is little new information to extract from this paper. The pose representation and the architectural details are quite standard, and no new data is presented.
Additionally, some technical details are overlooked and not clearly explained, for example, why the input to the system is orientations instead of the raw information of IMUs which is angular velocities? What is the physics optimizer?
What is the main difference between this method and UIP? For example, one of the main claims is adding shape information, however, in the ablation we can see that it has a marginal effect in the final accuracy (SIP from 9.07 to 9.04). Only when distances are removed there is a clear degradation of performance. However, including distances extracted from UWB is not the key novelty of this paper, as many related works has already proposed the use of these sensors.
- Weak Evaluation:
The quantitative evaluation left me with several questions. First of all, there is little difference between MISP and other methods such as UDP in Table 1. Similarly, in Figure 3 there is almost no difference between MISP and UIP.
Why some methods are only shown in some experiments? For example, ASIP is in Figure 3 but not in Table 1, UDP is not shown in Figure 3, the qualitative companion video only compares with ASIP and PNP.
The qualitative comparison only shows basic locomotion, more challenging motions could showcase the benefits of the method more clearly.
In Line 363, what is an acceptable level of jitter? Minimizing jitter is not always desirable as it can produce over smoothing. Provide the jitter value of the dataset.
Why the standalone shape accuracy is not evaluated in the real data on the UIP dataset?
Questions for authors
What is a clear difference in your proposed approach compared to previous work like UIP? If any, which evaluation clearly shows the importance of this difference?
Lines 185–186: Is UWB truly drift-free? Does it require external devices or a fixed reference frame to achieve drift-free tracking? As I understand it, UWB primarily measures distances between devices and does not inherently provide a global reference frame. One of the main challenges of IMU-based methods is root drift, and it is unclear to me how UWB alone can address this issue. Could the authors clarify how root drift is handled in their approach?
2 comments
Thank you for your response. I understand much better some of my concerns related to clarity of exposition and soundness. However, the main weaknesses of the paper about novelty and evaluation are still persistent and would require a major revision. Therefore I am keeping my original score.
Response to Reviewer mrGQ
TL;DR:
Q2 (Is UWB drift-free & how is global root drift handled?): We agree completely: inter-sensor UWB distances dt∈R15 measure internal pairwise geometry and provide no external global reference. As clarified in Sec. 3.1 (L159) and Sec. 3.5 (L291), UWB is "drift-free" only in bounding local pelvis-relative articulation (Θ^t) without integrating inertial history. Global translation pt∈R3 is recovered downstream using PNP's contact-driven physics optimizer (Yi et al., 2024) on a kinematic chain scaled by b^, using FK(Θ^t;b^) and foot-contact constraints. In Fig. 9b (p. 23), cumulative translation drift still grows with distance, but better local poses and leg lengths give MISP lower drift than PNP and SAIP.
Q1 & W1, W3 (Distinction from UIP & why shape matters):
w/o shapewas 9.07∘→9.04∘ (Sec. 4.4.2, Tables 4–5):w/o shapein Table 4 was retrained from scratch (absorbing average scale); on our frozen estimator (Table 5, p. 10), theAveragetemplate gives 11.41∘ SIP (4.76 cm Pos Err). Moreover, 32/45 TotalCapture sequences open with a motionless T-pose; skipping static openings via our unsupervised motion gate (Eq. 5, p. 17) lowers SIP to 8.77∘ (3.41 cm Pos Err), closing 72% of the gap fromAnatomy only(9.05∘) to GT bones (8.66∘).W2 & W4 (Technical & evaluation details):
w/ dynopt) and 0.14, staying below GT jerk and beating ASIP in 1–13 Hz PSD (Fig. 8, where full-sequence SIP is 8.10∘ vs. 8.23∘). The video compares ASIP (window seams) and PNP (contact-pinned stiffness) as opposite smoothness baselines and includes dynamic turning andfreestylemotions (Fig. 9a).