- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper addresses 3D animal pose estimation under limited data. The proposed framework is human-to-animal transfer with LoRA, skeletal constraints including bone length supervision, and Chordal Trajectory Branching (CTB). In skeletal refinement, predefined species-specific bone lengths are used as the ground truths for regularization. CTB is used in inference phase to integrate multiple hypotheses. The proposed framework is evaluated on Animal3D and CtrlAni3D, showing comparative benefits in P-MPJPE.
Critical strengths
- Human-to-animal transfer is a logical and useful direction for improved animal 3D pose estimation, and the Introduction section presents the motivation well.
- In Section 3.3, the proposed method is interesting and seems reasonable for GCN adaptation across heterogeneous skeletons.
- In Table 3, the benefit of skeletal supervision is presented and justified well.
Critical weaknesses
- The benefit of the proposed method is not validated against a naive LoRA baseline. The backbone and flow matching losses largely follow FMPose3D, and Table 2 does not provide a baseline that is human-pretrained and naively finetune with LoRA (no GraphLoRA, no skeletal refinement, etc). To validate technical novelty, it would be better to compare with the naive LoRA baseline under the same parameter budget.
- The proposed framework seems inefficient. While the parameter size of the original backbone is 16.3M, the propose method uses 4.4M LoRA parameters, which is roughly 27% of the original parameter size. As there is no train-val-test split available for hyperparameter tuning, there is a possibility that the model is overfit to the target benchmark.
- The CTB ablation is required. The Figure 3 and Figure 9 do not ablate binary ablation (w/o CTB, with CTB).
- Speed benefits presented in Figure 3 and Figure 9 do not convince actual usefulness. Vanilla multi-hypothesis inference could be parallelized in mini-batch. It would be more convincing to report the actual latency against non-CTB baselines.
- The proposed framework might not properly utilize human prior. While FMPose3D uses 17 joints, the proposed framework uses 26 animal joints, which has 1.5x more joints compared to the source domain. Combined with the Weakness 2, it might indicate that the proposed method does not show comparative benefit over finetuning the entire backbone.
- The Figure 8 is copy-pasted from the original FMPose3D paper without proper reference in the caption or in the main text.
Questions for authors
- How much is the propose method beneficial against naive LoRA baselines under the same conditions (e.g., parameter budget)?
- In Table 4, how does the best LoRA configuration change when train-val-test split is applied?
- How does CTB affect the performance via ablation study (w/o CTB vs. CTB)?
- What are the actual latencies of "w/o CTB" (no integration) and CTB?
- Does the proposed framework show comparative efficiency or performance benefits over finetuning the entire backbone (finetune from the human-pretrained backbone)?