- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents HR-ViP, a top-down framework for whole-body human pose estimation that leverages high-resolution Vision Transformers together with Train-Time Random Token Subsampling (TRTS), feature-map distillation, and batched person-crop processing. The goal is to achieve a strong accuracy–throughput trade-off in both single-person and multi-person settings. Experiments are conducted on COCO-WholeBody v1.0.
Critical strengths
-
Comprehensive single-person comparison. Table 1 covers a wide range of baselines, including CNN-based, CSPNeXt-based, and Transformer-based models, and includes strong recent methods such as RTMPose, DWPose, RTMW, and CIGPose. The comparison is thorough and the results are competitive.
-
Practical motivation. The trade-off between top-down accuracy and shared-feature efficiency in multi-person whole-body pose estimation is a real and important problem, especially for real-time applications.
-
Detailed runtime reporting in Table 1. The authors specify the hardware (Nvidia H200), batch size, mixed precision, and the absence of ONNX/TensorRT acceleration, which improves reproducibility.
Critical weaknesses
- The multi-person comparison does not match the rigor of the single-person comparison (major) Table 1 provides a strong SOTA comparison for the single-person setting. However, Table 2, which addresses the multi-person setting, does not include the strongest top-down methods that already appear in Table 1, such as RTMW, DWPose, and CIGPose. Instead, Table 2 compares HR-ViP against weaker or older full-image baselines such as CID, YOLOPose-L, and RTMO-L. No results on the CrowdPose dataset.
As a result, the abstract’s claim that HR-ViP “substantially outperforming the full-image methods in whole-body accuracy while retaining real-time throughput” is not directly supported. The reader cannot tell whether HR-ViP remains competitive against RTMW or CIGPose when multiple people are present.
-
Missing multi-person scaling analysis Table 2 only reports FPS@1, FPS@10, and FPS@15. There is no scaling curve showing how throughput and accuracy degrade as the number of detected people increases. Since the central motivation of the paper is efficiency in multi-person scenarios, a scaling analysis is necessary to substantiate the claim of “retaining real-time throughput.”
-
Novelty of TRTS is not sufficiently differentiated TRTS shares conceptual similarities with existing token compression and sparsification methods such as DynamicViT and Token Merging. Does TRTS differ fundamentally from these approaches, There is no ablation study for this.
-
Distillation recipe lacks differentiation from prior work Feature-map distillation has been widely used in pose estimation, including in DWPose and RTMW. The paper does not explain how the proposed distillation scheme differs from or improves upon these existing recipes.
-
Unclear relationship between detector quality and final WB AP In Table 2, HR-ViP-B + KD + DARK with Sparse R-CNN (DINOv3-L) has a lower Det. AP (58.4) than the YOLOX-L variant (60.7), yet achieves a higher WB AP (68.1 vs. 68.5) and much higher FPS@10 (49.8 vs. 32.6). This seems counterintuitive and needs explanation.
-
Runtime definition in Table 2 The runtime values for prior full-image methods “may use different hardware and are reported for reference.” This makes the FPS comparison in Table 2 potentially "meaningless".
-
batched person-crop processing seems not be tested in Ablation study.
Questions for authors
-
Can you provide multi-person results for RTMW, DWPose, and CIGPose on COCO-WholeBody, or explain why such results are unavailable?
-
How does TRTS differ from DynamicViT and Token Merging, both conceptually and empirically?
-
How does your distillation recipe differ from the two-stage distillation in DWPose and the distillation strategy in RTMW?
-
Can you provide a scaling curve of FPS and WB AP as the number of people increases from 1 to 30? or 10 is the up-limit of the paper?
-
Why does the Sparse R-CNN (DINOv3-L) detector yield higher WB AP and FPS despite lower Det. AP?
-
How much does the improvement comes from a stronger baseline: DINOv3?
-
What is the configuration of HR-ViP (ResizeConv, Top-k) in the scatter plot, and is it a single-person or multi-person result?