- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Local-to-Collective Predictability (L2CP), a framework for relating heterogeneous local interactions to collective degradation in multi-agent systems. The method learns an agent-level Interaction Predictability (IP) score from ego-centric spatiotemporal interaction histories and aggregates these scores through learned relevance weights into a Collective Predictability Score (CPS).
Both representations are trained through future-trajectory prediction and related auxiliary objectives without directly using degradation labels. Experiments on simulated Boids, Vicsek, and Cucker–Smale systems evaluate degraded-agent localization and the correlation between CPS and future collective degradation.
Critical strengths
-
The manuscript is generally well organized, and the motivation and methodology are easy to follow. Understanding how heterogeneous local interaction relate to collective degradation is an interesting problem with potential applications in swarm monitoring and distributed multi-agent systems.
-
The experiments examine agent-level degradation localization, collective degradation alignment, relevance-weighted aggregation, and generalization across different simulated interaction dynamics. This provides several complementary perspectives on the proposed representations rather than relying on a single evaluation metric.
Critical weaknesses
1. Limited methodological novelty and insufficient differentiation from existing representation-learning approaches. Although the paper introduces the concepts of Interaction Predictability (IP) and Collective Predictability Score (CPS), the underlying methodology primarily combines established components: interaction-history encoding, associative memory, MLP-based scalar prediction, attention-weighted aggregation, and trajectory-prediction supervision.
Specifically, IP is obtained by applying a sigmoid prediction head to learned agent representations, while CPS is a softmax-weighted average of individual IP scores. The trajectory decoder and associated learning objectives also largely follow conventional prediction-based representation learning.
While this combination is reasonable, I do not see a sufficiently distinct methodological innovation that explains why the proposed framework should be considered a substantial advance beyond existing interaction-aware representation learning or attention-based aggregation.
More importantly, the manuscript does not clearly establish what new information IP and CPS capture that cannot be obtained from existing learned trajectory representations, prediction errors, or uncertainty estimates. This limits the originality and broader methodological significance of the contribution.
2. The learning objective and experimental evaluation do not convincingly establish the claimed interpretation and advantages of IP/CPS.
The manuscript interprets IP as the degree to which local interaction histories support future-motion prediction. However, the proposed learning objectives do not sufficiently establish that the resulting scalar has this specific interpretation.
In particular, the predictive log-variance contains both independently learned variance estimates and additive IP/CPS corrections. Since the variance head can potentially compensate for these corrections, the NLL objective alone does not uniquely identify IP or CPS as measures of interaction predictability. The directional ranking objective further encourages IP to follow prediction-error ordering, making its distinction from a learned prediction-difficulty score unclear.
This issue also affects the interpretation of the learned relevance weights. While attention weights can improve aggregation, their learned values do not necessarily identify agents that are genuinely more influential in the evolution of collective degradation.
The experimental evidence is not sufficient to resolve these concerns. In Table 2, agent-level degradation localization achieves an AUROC of only 0.596, a relatively modest improvement over the simple statistical baselines. Moreover, the collective-level comparisons primarily use trajectory-prediction uncertainty rather than stronger architecture-matched or representation-matched alternatives.
I would particularly encourage comparisons with attention-pooled prediction errors, learned uncertainty-based scores, and similarly sized representation-learning models trained under the same prediction objective. These would help determine whether the reported improvements come from a genuinely useful predictability representation or simply from additional learned transformations and aggregation.
Finally, the experiments are restricted to simulated flocking dynamics with controlled degradation mechanisms. Although the evaluation across three simulators is useful, it provides limited evidence of generalization to more complex or realistic multi-agent interaction settings.
Questions for authors
-
What distinguishes IP from a learned predictor of trajectory error or uncertainty, and CPS from standard attention-weighted aggregation of agent-level uncertainty estimates?
-
Given that the learnable variance head can compensate for the IP/CPS terms in the Gaussian NLL, what guarantees that these scores acquire the intended predictability semantics? Do the authors have evidence that the representation remains stable or interpretable across different initializations?
-
Could the authors clarify whether architecture-matched baselines using prediction errors, learned uncertainty, or standard attention pooling were evaluated? What evidence establishes that IP/CPS provides benefits beyond these simpler alternatives?
-
Are there results evaluating L2CP under unseen degradation mechanisms or different agent population sizes, rather than only varying conditions within the same families of simulated interaction dynamics?