- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work proposes a framwork that integrates human pose information with spatial trajectories for human trajectory prediction. The framework employs an Orthogonal Prototype Memory Bank to convert kinematic signals into discrete behavioral primitives. The evaluation uses three benchmark datasets, showing improvements in trajectory prediction accuracy and intent prediction accuracy.
Critical strengths
The motivation for incorporating human pose information and bounding boxes is clear, with an example showing in Fig.1. The experiment shows that, for exisiting human trajectory prediction methods, incorporating extra biomechanical posture will benefit. The evaluation datasets are also complementary, including synthetic, 2D pose and 3D pose datasets. The ablation studies helps to understand the contribution of each component.
Critical weaknesses
-
The proposed method, including encoders for trajectories and body poses, with cross attention, and a DiT to denoise future trajectory. The proposed method itself is already a stand-alone human trajectory predictor, but the results of Bio-TAD alone is not reported at all. All results are combining other predictors with Bio-TAD. Could the authors report the performance of Bio-TAD or explain why if it cannot be used by itself?
-
What does it mean exactly for "backbone-agnostic compatibility"? The paper claims to be compatible with different trajectory prediction approaches. But it is not clear how Bio-TAD is combined with each baseline. Is the encoder of body pose can be plug-in, or the denoiser can be plug-in, or it is like for different approach, it needs to have different ways of exploiting the body pose information?
-
About social-transmotion baseline comparison. This baseline method already has the version which inlcudes trajectory, 2D/3D pose, and bounding boxes. So does the reported values include social-transmotion method with pose and bounding boxes version in the original paper, or only the version with Bio-TAD? And how to report the ade_min20 for social-transmotion as it only has deterministic prediction? And why in table 3, JTA and Urban results are skipped?
-
Inconsistency of the results. Some reported values are not consistent over tables. For example, Social-LSTM IR value for T=12 is different in table 6 and table 10.
-
About the evaluation metric, IR.
- Among 8 intent categories, only the turns are reported. If the intent evaluation is claimed to be main contribution of the work, all categories can be reported to strengthen the claim.
- The definitation of IR is: the ratio of the K predicted trajectories that accurately correspond to the ground-truth semantic class. For JRDB, K=1, how does the IR computed in this case, like shown in table 11?
-
It would be helpful to show statistics signifance for the reported results, especially when the gain is marginal, like Urban dataset results in Table 3. The results include std over multiple random seeds, paired significance tests, would be helpful to strengthen the claim.
-
The proposed method is a diffusion-based predictor. It would be helpful to include more recent diffusion-based predictors like MoFlow [1] or the intention-aware diffusion models [2], which is mentioned in related works already.
[1] Y. Fu et al. MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation. CVPR 2025.
[2] Y. Liu et al. Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction. AAAI 2026.
Questions for authors
Same as weaknesses.
11 comments
Response to reviewer pUJf
(Continued from Part 1/3)
Q3.1 & Q3.2: Social-Transmotion Comparisons & Multimodal Adaptation
- Q3.1 (Comparison Against Native Pose-Integrated Social-Transmotion): Our reported values explicitly include and compare against the original Social-Transmotion method's native pose-integrated version. To strictly isolate the performance gains of our proposed architecture, we evaluated three distinct configurations for Social-Transmotion, as documented in Tables 2 and 3 of the manuscript:
- Trajectory-Only: The base model using purely historical coordinate sequences.
- Base + Native Pose (Original): The baseline's original continuous concatenation method for integrating pose and bounding boxes (yielding a deterministic ADE/FDE of 0.37/0.73 m on JRDB, as shown in Table 3).
- Base + Bio-TAD (Ours): Our proposed framework replacing the native pose integration with our Orthogonal Prototype Memory Bank (yielding a superior deterministic ADE/FDE of 0.35/0.69 m on JRDB, as shown in Table 3). By reporting all three versions, we ensure a fair comparison. The results confirm that our predictive improvements stem specifically from how Bio-TAD discretizes biomechanical data into behavioral primitives, rather than just the mere addition of pose and bounding box inputs.
- Q3.2 (Multimodal K = 20 Adaptation & Missing JTA/Urban Results): The reviewer correctly points out that the native Social-Transmotion architecture is inherently deterministic. To ensure a fair multimodal comparison (minADE₂₀) against generative frameworks in Table 3, we adapted the unaugmented baseline by appending a standard Conditional Variational Autoencoder (CVAE) output head to its spatial encoder. This standard modification allowed the baseline to generate the K = 20 probabilistic samples required to calculate the metric. In contrast, our deterministic K = 1 evaluations in Table 2 evaluate the unaltered, native architecture. For our proposed Social-Transmotion + Bio-TAD configuration, the K = 20 samples are generated entirely through our framework's integrated Diffusion Transformer (DiT) denoiser, resolving the baseline's deterministic limitation without the need for a CVAE head. The omission of the JTA and Urban results for the native pose-integrated Social-Transmotion baseline in the initial submission occurred because the original authors did not report multimodal (K = 20) metrics for this specific variant (whereas JRDB is deterministic at K = 1, allowing us to directly utilize their published numbers). We have now fully trained the CVAE-adapted version of their pose-integrated architecture on the JTA and Urban datasets to generate the required K = 20 probabilistic samples and updated Table 3 in the revised manuscript with the complete comparative results.
Q4: Social-LSTM Intent Rate Discrepancy Between Table 6 (now Table 7) and Table 10 (now Table 12)
We thank the reviewer for pointing out this clerical error. We have corrected the discrepancy in the revised manuscript.
The Intent Rate (IR) values for the Social-LSTM baseline reported in original Table 10 (Table 12 in the revision) represent our canonical, final evaluation on the 128-sequence JTA test split (using 50-step DDIM at η = 0.0). The discrepancy occurred because the Social-LSTM rows in original Table 6 (Table 7 in the revision, our Capacity-Matched Ablation) inadvertently retained preliminary numbers generated during an early tuning phase on the validation split, which we had used to verify the scaling of the recurrent layers before running our final test suite. While the AutoBots rows and all geometric metrics in original Table 6 (Table 7) were properly updated to the canonical test-split results, we unfortunately missed updating the four Social-LSTM IR columns.
We have updated Table 7 to reflect the canonical test-split results, ensuring complete consistency with Table 12 across the manuscript, and double-checked all other tables to ensure absolute consistency. Importantly, updating these values to the correct test set leaves the core conclusion of our capacity-matched ablation (Appendix A.3) entirely unchanged: scaling the raw parameters of a coordinate-only model (Capacity-Matched) yields only marginal performance gains, whereas integrating the structural innovations of the Bio-TAD framework within the exact same ~11.7M parameter budget drives substantial geometric improvements and semantic gains.
(Continued in Part 3/3)
Response to reviewer pUJf
(Continued from Part 2/3)
Q5.1 & Q5.2: Intent Category Selection & Deterministic (K = 1) Intent Rate Definition
- Q5.1 (Focus on the Four Turn Intent Categories): We appreciate the reviewer's suggestion to include all eight intent categories. We intentionally focused our reporting on the four turn categories (Left, Right, Far Left, Far Right) because they represent the specific, highly stochastic maneuvers where conventional coordinate-only models structurally fail. Categories such as Idle, Stopping, Starting, and Straight represent linear or static behaviors. Standard baselines already achieve exceptionally high intent alignment on these classes because macroscopic coordinate momentum alone is sufficient to predict them. Including these macro-spatially trivial classes in our main tables would saturate the average scores and mask the specific capability Bio-TAD was designed for: leveraging pre-movement biomechanical cues (like pelvic or shoulder rotation) to anticipate abrupt directional changes before spatial displacement occurs.
- Q5.2 (Meaning of Intent Rate at K = 1 in Table 11 / now Table 13): We thank the reviewer for pointing out this ambiguity in our metric reporting. To clarify, Equation 8 defines the Intent Rate (IR) for a single pedestrian prediction instance. When the evaluation is deterministic (K = 1), as in the JRDB dataset, the per-instance IR simplifies to a binary indicator: it is
1(100%) if the single predicted trajectory matches the ground-truth intent class, and0(0%) if it does not. The values reported in original Table 11 (Table 13 in the revision) are the dataset-wide averages of these per-instance scores for each respective intent category. Therefore, in the K = 1 setting, the aggregate IR mathematically equates to the standard Top-1 semantic classification accuracy for that specific maneuver across the test set. We have updated Section 4.2 in the revised manuscript to explicitly state this dataset-level averaging for both multimodal (K = 20) and deterministic (K = 1) settings.
Q7: Comparison with Contemporary Diffusion Predictors (MoFlow)
We thank the reviewer for this constructive suggestion. We agree that including contemporary diffusion-based predictors provides a more robust benchmark for our DiT-based framework. In our revised manuscript, we have implemented and evaluated the recent MoFlow architecture (alongside the intention-aware diffusion model referenced in our related work). We evaluated both the native MoFlow baseline and our Bio-TAD-augmented version on the JTA dataset.
As shown in our updated Table 3 and Table 12 (original Table 10), the native MoFlow model is highly competitive (achieving a minADE₂₀/minFDE₂₀ of 0.60/1.36 m). However, because it remains a coordinate-only predictor, it still struggles with pre-movement intent alignment during highly stochastic maneuvers (achieving only a 36.50% Far Left Turn IR). When MoFlow is integrated with the Bio-TAD framework to explicitly process discrete biomechanical priors, its spatial error drops to 0.52/1.03 m, and its semantic Intent Rate improves by +17.80% for sharp turns. We have added these models to our baseline suite across all relevant tables to strengthen the comparative evaluation of our diffusion objective.
Response to reviewer pUJf
Q1: Standalone "Vanilla Bio-TAD" Evaluation & "Backbone-Agnostic" Terminology
We thank the reviewer for this observation. The reviewer correctly notes that the architecture presented in Figure 2—comprising the spatial/biomechanical encoders, asymmetric cross-attention, and the DiT denoiser—functions as a complete, standalone trajectory predictor.
As these new results demonstrate, the standalone Bio-TAD architecture is highly competitive. The native spatial transformer efficiently captures macroscopic routing, while our core innovations—the Orthogonal Prototype Memory Bank and target-oriented AdaLN engine—operate exactly as designed.
Q2: Uniform Integration of External Baselines
We appreciate the reviewer highlighting the need for clearer architectural documentation regarding how external baselines integrate into our framework. The integration mechanism is completely uniform across all baselines; there are no model-specific methods for exploiting body pose information:
(Continued in Part 2/3)