- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
SpatiotemporalPE replaces raw time indices with a coordinate that reflects how much the observed system changes over time. The coordinate is estimated from observation differences using local averaging and noise correction, and then used in rotary positional encoding. The authors evaluate the method on molecular dynamics prediction and video understanding.
Critical strengths
- The motivation is well founded: the same time interval can contain very different amounts of change, and the paper turns this observation into a concrete modification of positional encoding.
- Evaluating the idea on both molecular dynamics and video is useful. The simple cumulative-coordinate baselines clarify the contribution of the local, noise-aware estimator, and the video comparison holds the backbone and training setup fixed.
Critical weaknesses
- The molecular dynamics experiments lack the most direct control: the same model and training setup with ordinary time indices. Neither published comparisons nor SimpleV1/SimpleV2 fill this gap; the latter support the local estimator within the same architecture but, since they also use observation differences, say little about the coordinate itself. The video comparison is better controlled, but the 0.78-point gain is reported without variance across training runs and should be treated as suggestive.
- The construction of f_k is underspecified for autoregressive use. The local window W_k is centered at t_k, and λ is estimated from the whole observation sequence, so the coordinate at a given history position depends on later positions in the input window. This does not mean the model uses future ground-truth observations; the coordinate can be recomputed from the available history and generated predictions. But the paper does not say how the window is truncated, how λ is updated, or whether f is recomputed after each generated snapshot. These choices affect both the autoregressive molecular dynamics rollout and streaming use; without them, the rollout is difficult to reproduce or audit.
Questions for authors
- Please compare against ordinary time indices with the same molecular dynamics backbone and training setup.
- Please specify how the window is truncated and λ updated during autoregressive rollout, and whether f is recomputed after each generated snapshot.
- Please fix the unresolved cross-reference in Section 3.2 (“as illustrated in ??”) and reconcile the 4K6W MAE, reported as 2.670 in Table 1 and 2.702 in Table 7.