- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
JFER constructs a bank of joint endpoint intentions, decodes six base trajectories, and selects six additional intentions based on predicted support and endpoint coverage. It creates trajectories for the additional intentions by adapting base trajectories, then refines twelve candidates and returns six predictions. The paper reports a test Soft-mAP of 0.2868 on WOMD Interaction Prediction.
Critical strengths
Interactive motion forecasting needs to represent plausible joint futures while avoiding repeated predictions of similar outcomes. JFER separates these concerns by first selecting joint intentions supported by the scene and then checking the decoded trajectories for endpoint regions that remain underrepresented. This distinction between plausibility and coverage provides a useful way to think about candidate selection.
Critical weaknesses
The paper’s main weakness is that its many design choices are difficult to understand, insufficiently motivated, and incompletely specified.
Presentation
- The method is difficult to follow. Key steps are introduced without a clear account of how they connect; for example, the anchor selection mentioned in Line 171 is explained only in Appendix A.3 (Lines 688–708).
- Core representations are unclear. Eq. (3) does not adequately define how the intention features are constructed or how scene context differs from scene memory (Lines 164–181).
Design motivation
- Same-index reference pairs lack a rationale. Eq. (4) favors pairs formed from the two agents’ anchors at the same slot index, without explaining why those indices correspond across agents (Lines 182–187).
- Donor-based construction is difficult to justify. A new intention may involve different interaction timing or crossing order from the nearest base trajectory; endpoint proximity alone does not explain why that trajectory is a suitable motion donor (Lines 214–240).
Implementation and evidence
- The bank-prior logit is underspecified. The paper states that combines marginal intention evidence with learned pair compatibility, but does not specify how these terms are computed and combined. This matters because the logit affects both initial pair assignment in Eq. (4) and complementary selection in Eq. (5) (Lines 180–187, 196–211).
- Assignment supervision is unclear. The paper mentions straight-through assignment and coverage and uniqueness objectives, but does not clearly connect these objectives to the energy in Eq. (4) (Appendix A.6, Lines 750–754).
- Trajectory generation and refinement are underspecified. The inputs used to predict the corrections in Eq. (8), and the temporal tokens and prediction features used in Sec. 3.4, are not sufficiently defined (Lines 227–253).
- Final selection is underspecified. Selection and admission logits determine which candidates are output, yet their input features and prediction heads are unclear; the supervision of selection logits is also unclear.
- The source of the main performance gain is unclear. In Table 3, Direct uses the same scene encoder and joint decoder as the Structured Base but bypasses the entire intention bank and pair-assignment pipeline. The large gap therefore does not isolate the benefit of structured candidate selection from the effects of additional features, conditioning, or model capacity. Meanwhile, the gains from the individual design choices in Tables 4 and 5 are relatively small. It remains unclear which part of the proposed method accounts for the substantial improvement in Table 3.
Questions for authors
-
How are the intention features, scene context, and bank-prior logit computed (Eqs. (3)–(4))? Why are the two agents’ anchors paired by slot index, and how is the assignment energy supervised?
-
What donor and new-intention features are used to predict the gate and corrections in Eq. (8)? How can donor adaptation represent a different interaction timing or crossing order?
-
How are the temporal tokens and residuals in Sec. 3.4 constructed? What produces the selection and admission logits, and how is each score supervised?
-
Which components account for the large gain over Direct in Table 3? Please separate the effects of the bank, pair selection, role-aware assignment, and query adaptation, and quantify how much complementary expansion contributes to the final six predictions.