- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
ACT separates the forecast for a target variable into a state and an action. The state is encoded from the target's own history, and the action is generated from the joint history of all variables and applied as an update to that state before a shared head produces the forecast. The motivation is that existing multivariate forecasters change their forecast for a target as its context changes, even when the target's own history is fixed, yet this change is mixed into the final output and cannot be measured in isolation. ACT addresses this with a fixed-state intervention protocol. The target state is held fixed and only the action is replaced, so the forecast change caused by the context can be measured and replayed exactly. LAB is the paper's main realization of the action generator. Its multiplicative routes allow the action to be extracted in closed form, and low-rank gates keep the computational cost down. On ECL and Traffic, low-rank LAB reduces per-epoch training time by about 42% and 56% relative to dense LAB (Table 27). For validation, ACT is compared with 12 baselines on eight benchmarks and is best or tied-best on four datasets in MSE and on four in MAE (Table 2, Appendix C). In the trained models, replacing the learned state update with zero, norm-matched noise or an update shuffled across test histories raises the error in all 20 checkpoints (Table 3). The paper also tests whether context information can be read out linearly from the action (Table 6) and compares LAB with other action generators such as direct scaling (Table 7).
Critical strengths
-
The fixed-state intervention experiments are systematic and directly test the paper's central claim that the action carries meaningful information beyond the state. In the trained models, the authors replace the update D added to the state not only with zero but also with norm-matched noise and with shuffled updates that preserve the empirical distribution. The native D performs best across all 20 models (Tables 3, 14). The shuffle condition is the most telling. It keeps the distribution of update values unchanged and still degrades performance substantially, which shows that the update carries state-specific directional information rather than mere magnitude. This supports the paper's central argument that the separation of state and action is a meaningful structure.
-
The evaluation is broad, and the paper documents everything needed to reproduce it. Eight benchmarks of different types are used. Appendix A reports the hyperparameters, the selected configuration for every dataset and horizon cell (Table 8) and the exact run commands, and Appendix G reports the hardware and the full configuration-search cost (Table 28). The analysis of how context influences the forecast is similarly thorough, covering error alignment (Table 4), the interaction between context groups (Table 5) and linear readouts of context from the action (Table 6). This makes the results easy to verify and adds to my confidence in the claims.
Critical weaknesses
-
The methodological novelty of ACT and LAB is limited. As the authors state in Sections 1 and 2, the core operation, multiplying the retained state by coefficients generated from the joint history, is conventional conditional modulation in the style of FiLM, and the contributions are defined as the state-action interface and the fixed-state intervention protocol. When LAB is replaced by a simpler direct-scaling generator, the MSE is similar or better on Weather, Solar and Traffic, and LAB is ahead only on ECL (Table 18). The presentation also makes the contribution harder to assess. The paper introduces many terms such as action, applied update, forecast correction, recipient and replay, while the gate in Eq. 4 is defined only in Appendix A.1 (Eq. 9) and the recurrence for the route scales , , only in Appendix B.2 (Eq. 11), so LAB and Prop. 1 cannot be reconstructed from the main text alone. In short, the substantive contribution is closer to recasting existing multiplicative modulation as an evaluation perspective than to a new architecture, and the paper does not show convincingly that this perspective yields insights that existing methods cannot provide. This is the main reason for my weak-reject recommendation.
-
The practical forecasting gain from adding the action is limited. ACT is ahead on four of the eight datasets, but it is behind the dependency-aware models on the high-dimensional datasets where cross-variable information should matter most, namely ECL and Traffic (Table 2). At H=720, ACT is behind the best linear or mixer model on ETTh1, ETTh2 and ECL (Table 11). For ETTh2 at H=720, validation selects depth 0, which means no action at all (Table 8). Compared with models retrained without an action, the advantage ranges from 0.2% to 7.1% in MSE (Table 19).
Questions for authors
The following are clarification requests, and the answers would affect my assessment.
-
The fixed-state context-swap protocol is presented as a key contribution. What does it reveal that analogous interventions on existing models cannot, for example swapping the non-target inputs to a cross-variable model like iTransformer or TimeXer, or to a channel-independent baseline? A comparison under the same protocol would make it clear whether the insight is specific to the ACT interface.
-
Section 3.3 notes that direct scaling yields a coefficient that is explicit by construction, and Table 18 shows direct scaling matching or outperforming LAB on Weather, Solar and Traffic. What does LAB offer that direct scaling does not? The training-cost reduction in Table 27 compares low-rank LAB with dense LAB, so it does not answer this question. Is there any analysis in the paper, such as the route geometry in Section 4.5, that requires LAB and could not be carried out with direct scaling?
-
Appendix C describes the baseline numbers as reference point estimates. Where do they come from, and were the baselines tuned with a search comparable to the 20 configurations per dataset and horizon cell that ACT receives? Appendix A.2 states that sample standard deviations are computed over the five seeds, yet Tables 2 and 11 to 13 report means only. Please report those standard deviations for ACT and, where possible, for the baselines as well.
-
At H=720, ACT is behind the best linear or mixer model on ETTh1, ETTh2 and ECL (Table 11), and validation selects depth 0 for ETTh2 at H=720, which means no action is applied (Table 8). Does the action contribute little at long horizons? If so, please explain why, and state whether the action gives any practical forecasting gain at long horizons.