- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes BRAID (Bilevel Representations for Agent Interaction Dynamics), a hierarchical sequential latent-variable model for generative multi-person interaction, framed as meta-transfer learning over arbitrary context sets. The social state is factored into a group latent that captures shared interaction dynamics and person latents that encode individual behaviour conditioned on the evolving group context. Scenes are represented in a unified SMPL-X parameterisation, and training combines a temporal Neural Process formulation with a precision-weighted variational posterior and a frozen pretrained motion VAE decoder, so that forecasting, tracking/in-filling, and response generation differ only in which joints and people are observed. Results across five social-motion datasets show that BRAID achieves competitive performance in generative multi-person interaction. The latent analysis further indicates that the group latent captures activity-level structure, while the person latents preserve individual identity across different groups.
Critical strengths
++ Under partial observation, the proposed method remains sufficiently stable and robust, outperforming the compared baselines on the majority of metrics.
++ The embedding analyses provide solid evidence that the bilevel latents are well structured and informative.
++ Code is provided, which facilitates reproducibility.
Critical weaknesses
-- In social forecasting, the SDTW and Cr. SDTW metrics are consistently worse than those of the compared methods. The authors should clarify whether this phenomenon indicates limitations of the approach in certain respects.
-- Although the IP metric appears favourable in the reported results, the provided video samples show that the generated multi-person interactions are rather simple and involve almost no physical contact, which may also account for the low interpenetration rate. The paper lacks experimental validation on complex, contact-rich multi-person interaction generation.
-- The experiments appear to be restricted to scenes with a fixed number of participants. Can the method handle scenarios where the number of people changes dynamically over the course of an interaction, such as participants joining or leaving?
-- A closely related work, Disentangled Hierarchical VAE for 3D Human-Human Interaction Generation (ICLR 2026), is neither cited and discussed nor experimentally compared in the paper.
-- The reference list contains over 30 arXiv citations, many of which have been formally published at conferences or journals. These should be replaced with their official versions.
Questions for authors
See above.
Thank you for the author's detailed response. I do not have additional questions regarding questions 1 to 3.
However, the author's response regarding the performance gap is not convincing enough. SDTW is still 5.195, significantly behind MAGNet's 1.560; MAGNet’s DIV of 0.52–0.71, although an improvement upon MAGNet, is still largely trailing against 65–90 for a random real clip. In addition, the author never explained in detail how the MAGNet baseline was run. So it's hard to compare these numbers with the correct context.
In addition, in question 6, the authors did not directly answer my question regarding MAGNet's setup. In question 7, the authors have confirmed, instead of resolving, my concern regarding body shape leaking identity. Body shape alone retrieves identity about 100% of the time, and the person latent only retrieves it 41.4% of the time, so the latent adds nothing beyond shape for identity.
Overall, I would like to keep my rating of weak rejection.