- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper examines what successful activation interventions in autoregressive time-series foundation models (TSFMs) can establish beyond their immediate effects on model outputs. The authors identify four causal claims as persistence, location specificity, emitted-output sufficiency, and numerical attribution. They propose corresponding controls: release, matched-site interventions, replay and simplification of emitted values, and an activation-by-scale factorial analysis. Through experiments on Chronos-T5 using synthetic and observed time series, the authors show that high restoration does not necessarily imply persistence, that several terminal intervention sites yield comparable effects, and that persistent effects can propagate through emitted forecast values, with additional contributions from the key–value cache at upstream decoder sites. Furthermore, a reanalysis of six published Chronos steering cases reveals that output rescaling, rather than activation transplantation, determines the displayed median-level steering direction.
Critical strengths
- The paper addresses an important and underexplored problem in the interpretability of time-series foundation models. The distinction between intervention effectiveness and stronger causal claims is conceptually valuable.
- The experimental design is generally careful, incorporating controlled comparisons, paired sampling, fixed numerical scaling, and cluster-level uncertainty estimation.
- The time2time reanalysis is particularly insightful, revealing that output rescaling determines the displayed median-level steering direction in the examined Chronos cases, while activation transplantation influences tails and drawdowns.
Critical weaknesses
- The proposed controls are conceptually related to existing activation patching, causal mediation, and factorial ablation techniques. Their methodological novelty beyond adapting established approaches to autoregressive TSFMs could be clarified.
- Most findings are based on Chronos-T5, while experiments on Lag-Llama and Toto remain inconclusive, limiting evidence for cross-architecture generalizability.
- Some prespecified thresholds (e.g., restoration ≥ 0.5 and the ±0.10 equivalence margin) lack sufficient theoretical justification.
Questions for authors
- What are the main methodological distinctions between the proposed controls and existing approaches such as causal mediation analysis, activation patching, and factorial ablation?
- What explains the strong interaction between emitted tokens and cached internal states at early decoder layers? Can the authors provide further mechanistic insights into this interaction?
- What explains the strong interaction between emitted tokens and cached internal states at early decoder layers?
- Can you provide more justification or sensitivity analyses for the prespecified numeric thresholds (e.g., 0.50/0.30 for persistence, ±0.10 equivalence), and do the qualitative conclusions change under plausible alternatives?
- Could the authors elaborate on why the interventions on Lag-Llama and Toto failed to produce sufficiently strong active effects or persistent effects? Are these failures attributable to architectural differences, intervention-site selection, or other factors?
6 comments
Q2–Q3: The early-layer interaction (we read these as one question). Short answer: we can show how the interaction is spread across the cache, but not what the cached entries encode, so we make no mechanistic claim.
The effect. At decoder layer 0 on synthetic series, the edited cache on its own adds nothing measurable (−0.012 [−0.045, 0.021]), but together with the edited emitted values it adds 0.278 [0.173, 0.388]. One hypothesis consistent with this, which our analyses do not test, is that later positions attend to cached keys and values that help only when the inputs follow the edited trajectory.
How it is spread. New analyses put pieces of the edited cache back into the replay run (§4.4, Appendix B.10):
- By layer: no single layer recovers the whole effect; the largest share is at layer 5 (56%), and the layers overlap rather than add.
- By attention head (layer 5, chosen after the layer result): no single head carries it; removing any one costs at most 4% of the gap.
- By position: it sits mainly in the entries written at the three emitted-token positions.
Outside our own edits. In our adaptation of Wiliński et al.'s steering (Appendix D.2), cached decoder state again mattered beyond the emitted values at the paper's setting. On our observed pairs, the layer-0 comparisons are descriptive only.
Q4: Thresholds. The cutoffs are operational criteria fixed before each experiment, not externally validated margins, but each has a direct reading and a standard form. R ≥ 0.50 implies, in pooled distance, that the released forecast is no farther from the donor's forecast than from the recipient's own. The ±0.10 margin is one tenth of the way from no repair (0) to full repair (1), applied with the confidence-interval equivalence criterion (Lakens, 2017). The 75% bar follows the fraction-retention form of non-inferiority testing (Rothmann et al., 2003). These justify the form of each criterion, not its exact value. A post-hoc check from the saved estimates (new Appendix A.4) gives:
- Persistence: the synthetic result passes and the observed-pair result fails for every common cutoff from 0.10 to 0.94, applied to both the estimate and its lower bound.
- Matched sites: all three intervals lie within ±0.011, far inside the prespecified ±0.10 margin.
- Mean-repeat retention: the lower end of its interval is 0.987, far above the prespecified 75% bar.
The original verdicts are unchanged.
These describe precision; they do not justify a particular margin, and failing a bar is not evidence of a zero effect.
W2 and Q5: Lag-Llama and Toto. We agree that our evidence beyond Chronos-T5 is limited. Limitations (§6) now says that all persistence and routing results are on Chronos-T5, and that our Lag-Llama and Toto writes either did not work while active or did not persist. We did not vary architecture, site or strength systematically, so we cannot attribute the failures to a cause. In the main experiments, a write at every step did not reach the required active effect, so persistence could not be tested. A separate Toto write worked while active but failed its persistence criterion after one edited step. And time2time's Toto transplant has a large active effect (−442.6 index points) with no rescaling. A working Toto intervention is therefore possible; whether its effects persist remains open.
If these answers address your concerns, we would be grateful if you would reconsider your score.
Thank you for the careful reading and the specific questions.
In short. (1) Our controls build on standard intervention techniques (patching, mediation and factorial designs); a new table states what each builds on and what is specific to autoregressive TSFMs. (2) New analyses show that the early-layer interaction has structure by layer, attention head and position. We do not claim to know what the cached entries encode. (3) In a post-hoc check, both persistence verdicts are unchanged for every common threshold from 0.10 to 0.94. (4) We cannot attribute the Lag-Llama and Toto failures to a cause, and we now report them as boundary results.
What we have revised: a table relating each control to patching, mediation and factorial designs (Appendix A.3, Table 3); threshold sensitivity (Appendix A.4); the cache route in the main text (§4.4) with analyses by layer, head and position (Appendix B.10); other architectures stated as boundary results (§6 and Appendix D.1).
Q1: Relation to patching, mediation and factorial ablation. We do not claim to have invented these techniques. Each control is a specific use of one (new Appendix A.3, Table 3):
Transferring them required choices that language-model patching does not face: random draws are held fixed across runs, so that released, replayed and edited runs differ only in the edit; the edit is fully removed before later steps; and one factorial factor, de-normalisation, acts outside the network.
The contribution is turning these techniques into causal controls for TSFMs, and what that changes. For example, the factorial shows that the displayed median direction of a published Chronos steering result comes from output rescaling, not from the activation transplant. We also think the timing matters. Probing studies in language models adopted control tasks only after many claims had spread (Hewitt and Liang, EMNLP 2019); TSFM representation studies can build such controls in from the start. They are needed more here: steered text can be read and checked, but nobody can tell by looking whether a displayed change in a sequence of numbers came from the edit.