- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies forward-process design for multi-agent trajectory diffusion. Instead of using temporally independent white Gaussian noise, the authors introduce temporally correlated noise fields and investigate how the temporal structure of the corruption process should be matched to the dynamics of the underlying trajectories. The paper further proposes agent-type-specific forward processes, assigning different noise fields to players and the ball. Experiments on football, American football, and basketball trajectory generation show that appropriately structured noise can reduce displacement error and improve some aspects of motion realism
Critical strengths
-
The paper studies an important but relatively under-examined design choice in trajectory diffusion.
Rather than modifying the denoising backbone, the work asks whether the forward corruption process itself should reflect the temporal structure of the modeled data. The empirical setup is clear and the central hypothesis is easy to understand. -
The experimental analysis is systematic and informative.
The paper evaluates several noise fields with different temporal frequency characteristics and analyzes their behavior using low-frequency power and participation ratio. The sampling-rate experiment is particularly useful: the benefit of low-pass noise is substantially larger at 25 Hz than at 6.25 Hz, which supports the authors’ argument that the usefulness of correlated noise depends on the temporal structure of the data. -
The agent-type-specific forward process is an interesting extension.
Modeling players and the ball with different corruption processes is well motivated by their different dynamics, and the experiments show that the bespoke ball process can improve acceleration realism at high sampling rates.
Critical weaknesses
-
There is a substantial gap between the generality of the paper’s framing and the breadth of its empirical evidence.
The paper is framed as a general contribution to forward-process design for multi-agent trajectory diffusion, with sports presented primarily as a test bed rather than as the scope of the method. The abstract states that the noise fields can be tuned to the underlying process being modeled, and the conclusion formulates broader principles about matching corruption to temporal structure, sampling rate, and agent-specific behavior. However, all empirical validation remains within sports tracking domains. Although the paper covers multiple datasets, these settings share similar characteristics: continuous spatial motion, human players, and ball dynamics. It is therefore unclear whether the proposed design principle transfers to trajectory domains with abrupt maneuvers, contact events, different interaction structures, or substantially different temporal spectra. In my view, the current experiments support a domain-specific empirical observation more strongly than a general modeling principle. -
The core correlated-noise formulation has significant conceptual overlap with prior diffusion work.
Non-isotropic Gaussian noise, temporally correlated noise for sequential data, and data-dependent or structured priors have all been explored previously. The main novelty therefore appears to lie in the systematic application to sports multi-agent trajectories, the sampling-rate analysis, and the agent-type-specific extension, rather than in the broader idea of replacing white noise with structured corruption. The paper would benefit from positioning this boundary more explicitly.
Questions for authors
- Can the authors validate the proposed forward-process design principle on at least one non-sports trajectory domain?
For example, pedestrian trajectory forecasting, autonomous-driving trajectories, human motion, or robot trajectories would provide a substantially stronger test of the claim that the corruption process should generally be matched to the temporal structure of the data.
5 comments
Response to Rebuttal
I appreciate the authors' substantial additional experiments, which meaningfully address my concern regarding generalization beyond sports trajectories. I also acknowledge that the paper provides valuable empirical insights into the relationship between noise structure, sampling rate, and trajectory generation performance.
However, my concern regarding methodological novelty remains. Given the existing literature on temporally correlated noise and non-isotropic Gaussian diffusion, the core approach largely builds upon established formulations. The agent-type-specific forward process, while intuitively motivated, essentially assigns manually designed noise distributions to predefined agent types, without introducing a fundamentally new diffusion mechanism or a principled method for learning or adapting these distributions.
Therefore, while I recognize the strength of the empirical analysis and the improvements made during rebuttal, I remain unconvinced that the methodological contribution is sufficiently novel. I will maintain my original rating.
Thank you for your reply, and for confirming that the non-sport experiments address the concern about generalisation.
The focus of the paper is the design and refinement of the forward process, which you acknowledge as an important but relatively under-examined design choice. It states that correlated and non-isotropic noise are established, and that Ge et al. (2023) use the same AR(1) construction as our velocity-level field. In your review, you placed the novelty in the systematic application to multi-agent trajectories, the sampling-rate analysis and the agent-type-specific extension. That is how the revised paper frames its contribution.
Three of its findings change how structured noise should be used for trajectories:
- The training objective decides whether correlated noise helps. Earlier work with structured noise trains with the likelihood-based (whitened) loss (Lee et al., 2022; Biloš et al., 2023). On Bundesliga, whitening the loss of the velocity-level field raised averaged scene error by 7.9% over three seeds, which removed the whole benefit. The plain squared loss kept it. Appendix D derives why.
- A field can be checked before training. Low-frequency power ordered the six fields that trained (Spearman's ρ = −0.94 over seed means). A new sensitivity analysis over eight damping times (Appendix F) shows that the field outperforms white noise at a participation ratio of 1.76 and is worse than it at 1.49. Both statistics are computed from the noise field alone, before training.
- The benefit depends on the sampling rate. On public zebrafish data, the error reduction at 25 Hz was more than twice that at 6.25 Hz across all three seeds.
On the agent-type-specific process, you are right that the fields are designed, not learned. This was deliberate. The fields have no learned parameters, so every change in error can be attributed to the field itself. The choice of field is not arbitrary. Point 2 gives criteria that can be computed before training, and the paper shows that each agent type's field should be set in frames for its dataset and sampling rate. Learning the fields is a natural next step, and point 1 bears directly on it: training through the likelihood bound removed the benefit of correlated noise, so a field learned that way would not necessarily lower displacement error.
We thank the reviewer for this comment, which we agree with and have acted on. In the revised version we have added experiments on two public datasets outside sport and adjusted the framing to match the evidence.
Response to Weakness 1 and Question 1
New experiments. We evaluated the velocity-level field against white noise on:
We used the velocity-level field with the same damping time (τ = 20 frames) as on the sports data, with no retuning per dataset. Both datasets were resampled to 25 Hz and then downsampled again to 6.25 Hz, so we could also test the sampling-rate claim outside sport. We found similar improvements on the non-sport datasets as we did on the sport datasets.
Results.
Response to Weakness 2: overlap with prior structured-noise work
We agree with the reviewer's reading of where the novelty lies, and we have revised the paper to draw this boundary explicitly. We have made our position against previous work clearer in our introduction and related work.