- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
This paper addresses the issue of over-reliance on learned priors in mmWave-based human pose estimation due to sparse and unreliable radar observations. The authors propose MMJoints, a framework that augments pre-trained black-box pose estimators with two per-joint descriptors: Sensing Score and Reliability Score, which characterize local radar support and prediction reliability, respectively. To estimate these descriptors without ground-truth poses at inference time, the method leverages latent signal distribution modeling and surrogate pose estimation. The main contribution is a bias-aware pose representation that makes sensing support and prediction reliability explicit and actionable, improving downstream pose estimation and activity recognition without modifying the original pose estimator.
Critical strengths
-
The paper addresses an important practical challenge in mmWave-based pose estimation, where sparse and unreliable radar observations can cause models to over-rely on learned human pose priors. Explicitly characterizing sensing support and prediction reliability at the joint level is meaningful, particularly for downstream applications where inaccurate or insufficiently supported predictions may lead to unreliable decisions.
-
Generalizable Black-Box Framework. The proposed MMJoints framework operates as a post-hoc augmentation module without requiring access to or modification of the underlying pose estimator. This model-agnostic design makes it potentially applicable to different pre-trained architectures and facilitates integration into existing systems.
Critical weaknesses
- mmWave reflections originate from body surfaces rather than joint centers, making local radar returns an imperfect measure of sensing support. A joint predicted correctly despite sparse nearby returns may reflect effective information fusion from neighboring body parts, temporal context, and kinematic constraints, rather than harmful reliance on priors. Conversely, incorrect predictions despite strong nearby returns may arise from incorrect reflection-to-body-part associations. Although the proposed scores characterize local sensing support and prediction reliability, the paper does not clearly distinguish beneficial prior-based inference from harmful prior bias, leaving the interpretation of these mismatches insufficiently justified.
- The proposed method relies on learning a mapping from human poses to latent mmWave signal distributions. However, accurately modelling mmWave observations from human poses remains challenging due to complex reflections, multipath effects, and environmental variations, as highlighted by prior studies on mmWave signal synthesis (e.g., SynMotion, SenSys 2022). Although the authors model latent distributions rather than raw signals, it remains unclear whether the generated distributions can faithfully capture real-world radar observations. Consequently, the divergence between generated and observed distributions may reflect environmental variations rather than pose estimation errors, potentially undermining the reliability of the surrogate pose construction.
- The experimental comparisons are relatively limited, relying primarily on uncertainty estimation methods published between 2016 and 2021. Although the paper demonstrates improvements in downstream pose refinement and activity recognition, it lacks comparisons with recent downstream method. Especially Recent works, such as RadProPoser (IJCNN 2026) and UGSTM (2025), have already incorporated uncertainty modelling into radar-based pose estimation and skeleton-based action recognition, respectively. The paper would benefit from discussing these methods and, where experimentally feasible, comparing their uncertainty representations on downstream tasks to better establish the unique contribution of MMJoints.
- Since MMJoints is proposed as a model-agnostic add-on module, its applicability to more recent architectures remains insufficiently explored. Evaluating MMJoints with stronger skeleton-based action recognition models, such as SkateFormer (ECCV 2024) and FreqMixFormer (ACM MM 2024), or newer mmWave pose estimators such as Wave2Body (2026), would better substantiate its generalizability and practical benefits.
Questions for authors
- Can the authors provide controlled analyses showing how the descriptors distinguish beneficial use of contextual and kinematic priors from harmful prior-induced prediction errors?
- Can the authors validate the fidelity of the generated signal distributions under unseen sensing conditions? Additionally, does the distribution divergence reliably correlate with pose estimation errors rather than environmental variations?
- Can the authors provide controlled experiments demonstrating that the proposed descriptors distinguish harmful prior reliance from accurate predictions supported by contextual or kinematic information?
- Can the authors compare downstream performance using the original predicted poses augmented with MCD/DER/LULA uncertainty estimates versus MMJoints descriptors? Such comparisons would clarify whether the proposed descriptors provide additional benefits beyond existing uncertainty estimates.
- Can the authors compare MMJoints with recent uncertainty-aware methods and evaluate its integration with newer pose estimation and action recognition models to better demonstrate its effectiveness and generalizability?
- Can the authors clarify and compare the model sizes, training data, and supervision used by MCD, DER, LULA, and MMJoints to ensure a fair evaluation?
- Can MMJoints be extended to multi-person scenarios?