- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
BioHMR presents a SKEL-based framework for 3D human mesh recovery from images and video. Its main components are a learned SMPL-to-SKEL mapper for generating pseudo-SKEL supervision, the Biomechanics-Aware Spatio-Temporal Adapter (BASTA) with joint tokens, graph attention, and per-joint temporal attention, and an optional pose-aware patch selection mechanism for reducing inference cost. The paper reports strong results on COCO, LSP-Extended, 3DPW, and MOYO, together with lower joint-limit violation rates than SMPL-based baselines.
Critical strengths
- SKEL gives the paper a representation with joint-specific degrees of freedom, making joint-limit violations an explicit part of the evaluation rather than an unmeasured property of the recovered mesh.
- BASTA combines joint-token cross-attention, reasoning over the SKEL kinematic graph, and per-joint temporal attention within the ViT backbone.
- The evaluation spans image and video benchmarks and reports joint, surface, temporal, and joint-limit metrics, with ablations for the main components.
Critical weaknesses
-
The mapping from the 6D rotation output to the SKEL pose representation is not specified. Section 3.3.3 describes 24 joint rotations in a 144-dimensional 6D representation, conversion to Euler angles, and selection of 46 physiologically valid axes. It does not define the Euler convention (including rotation order and angle range), joint coordinate frames, or the exact conversion to the 46-dimensional SKEL pose vector. Appendix B.4 further writes the mapper as , with a 144-dimensional pose output, and feeds directly to in Eq. (5), while Section 3.6 defines . The conversion from the 6D representation to the 46-dimensional SKEL pose is therefore under-specified, and the paper does not provide enough detail to reproduce this part of the pose representation.
-
The paper uses ``valid by construction'' in two different senses. SKEL does remove forbidden rotation axes and therefore rules out gross out-of-plane motions at the structural level. It does not, by itself, keep every scalar joint angle inside its physiological range. The paper acknowledges this in Section 4.3, which states that a regressor can still hyperextend a joint, and Table 3 reports nonzero joint-limit violations at the strict and thresholds. The evidence supports a narrower claim about structural anatomical validity than a guarantee of complete joint-limit compliance.
-
The mapper objective does not establish that the SKEL pose is uniquely identifiable from mesh consistency. Equations (5)--(7) supervise vertices, joints, and a Laplacian residual, while Appendix B.4 states that the mapper uses no optimization-derived SKEL pose labels. Symmetries, pose and shape compensation, or pose and translation compensation can therefore leave multiple parameter settings with the same or nearly the same mesh and joint losses. Selective joint masking down-weights the joint loss in regions where SMPL and SKEL differ systematically, while dense vertex supervision remains. The paper does not show that these ambiguities occur for its SKEL implementation, so the precise issue is an unproved identifiability property rather than a demonstrated failure. The resulting pseudo-labels may produce the same mesh without being uniquely determined by the stated objective.
-
The temporal loss encourages smooth predictions, but it does not establish physical consistency. Section 3.6 penalizes adjacent-frame differences in rotation matrices and shape parameters. A constant but incorrect pose and shape can still make these temporal consistency terms zero, and the objective contains no velocity or acceleration limits, contact constraints, dynamics, or temporal regularization for camera and translation. The reported ACCEL reduction supports smoother predictions in the tested setting, while the ablation in Table 7 supports an empirical contribution from temporal attention. Neither result establishes physical consistency. The loss compares predictions at adjacent frames and places no direct constraint on the motion between them.
-
Equation (8) uses cross-attention weights as a proxy for patch importance, but the paper gives no result connecting this score to a patch's effect on the final prediction. Attention weights alone do not measure the magnitude or direction of the value carried by a patch, so a low-weight patch can still affect the output substantially. The paper does not provide an error bound or sensitivity analysis for this selection rule, and it does not show a concrete failure case.
Questions for authors
See weaknesses