- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies long-horizon failures in transformer-based neural event simulators using an M/M/1 queueing system. It shows that models with similar short-history test losses can exhibit substantially different behaviors during long rollouts. To diagnose these failures, the paper proposes Deep-Prefix Drift (DPD), which measures predicted queue increments on shared reference histories beyond the training length. It further introduces a supervision approach that fine-tunes models on longer contexts using oracle or simulator-sampled targets. Experiments evaluate the effectiveness of DPD in identifying severe failures and compare the proposed repair against several training baselines.
Critical strengths
- The paper identifies and empirically demonstrates a discrepancy between short-history prediction accuracy and long-horizon simulation behavior.
Critical weaknesses
-
Motivation and Necessity: The failure scenario studied by this paper appears to be largely induced by its model design. The M/M/1 queue's transition law depends only on the current queue length, making absolute event positions irrelevant to its underlying dynamics. However, the paper adopts sinusoidal absolute positional encodings and evaluates models at positions beyond their training length, where extrapolation failures are already well known. The authors' own experiments also show that none of the 30 models using ALiBi, NoPE, or mixed-position training exhibits severe failures, compared with 18 of the 46 models trained with sinusoidal absolute positional encodings. These results raise a fundamental question about the necessity of the proposed approach: why is it important to diagnose and repair failures that can largely be avoided by using other positional encoding techniques?
-
Validity of the DPD Diagnostic: It's unclear why DPD should reliably characterize long-horizon failure. DPD averages predicted queue increments across different states and positions, whereas the probability of crossing a queue boundary depends on the state-dependent transition dynamics throughout a rollout. As a result, a positive (or negative) average drift does not necessarily imply a high (or low) crossing risk. Counterexamples for both cases are also shown in the paper's results: model 53 has positive DPD but crosses the boundary in only 1 of 256 rollouts, whereas model 104 has negative DPD but crosses in 210 rollouts. This limitation also extends to the alternative positional encoding models, all of which have negative DPD despite some exhibiting up to 98 crossings, compared with the oracle's expected 2.86. To my understanding, DPD primarily detects a particular pattern of drift reversal; it cannot reliably characterize long-horizon failure in general.
-
Novelty of the Repair: The proposed repair method seems to be a straightforward application of long-context fine-tuning where the preceding diagnosis is almost not involved. Although DPD identifies potentially failing checkpoints, the repair applies additional supervision at predetermined deep positions without using model-specific diagnostic results to determine where or how to intervene. Additionally, the repair's comparisons against shallow supervision and continued training mainly demonstrate that training on longer contexts is more effective than additional training within the original context length. Given that the identified failures arise beyond the training length, this result is largely expected. Table 9 in the supplementary material also shows that ordinary long-sequence fine-tuning substantially reduces failures, from 255, 245, and 240 to 5, 71, and 7, respectively.
Questions for authors
-
Given that ALiBi, NoPE, and mixed-position training largely avoid the severe failures observed with sinusoidal positional encodings, what is the significance of the studied failure scenario beyond this particular model configuration?
-
Given the counterexamples in models 53 and 104 and the substantial crossing rates observed in models with negative DPD, why should average predicted drift be used to characterize long-horizon failure risk?
-
What specific role does DPD play in guiding the repair beyond identifying failing checkpoints, and what advantages does the proposed repair offer over ordinary long-sequence fine-tuning (which already substantially reduces failures in Table 9)?
## Response to Reviewer 7x19
We thank Reviewer 7x19 for the detailed technical critique, which motivated our comparison against ordinary long-sequence fine-tuning and our within-configuration ranking analyses.
1. Motivation and necessity given ALiBi, NoPE, and mixed positions (W1, Q1):
2. Validity of DPD, counterexamples (models 53 and 104), and negative DPD (W2, Q2):
3. Role of DPD in repair and comparison with ordinary long-sequence fine-tuning (W3, Q3):