- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes an interesting framework called EGA-WM for time-series forecasting with external evidence. The framework includes three steps to solve how to model actions, how to activate the actions, and how to leverage the actions to help time-series forecasting. The results on five electricity markets and two retail datasets support the usefulness of this approach.
Critical strengths
- The motivation is interesting and easy to follow, i.e., the same external event can lead to different responses under different system conditions. This gives the proposed formulation a clear purpose.
- The technical contribution is good. It separates action activation from the persistence of its effects, which is a useful design choice.
- The experiments are comprehensive, covering electricity and retail forecasting datasets, with different types of external evidence.
Critical weaknesses
- The authors used ‘action’ as the core contribution. I think it is necessary to clearly define the used ‘action’, and how the ‘action’ is related to the external evidence.
- I notice the model used two latent trajectories to compute the forecast adjustment. I suggest the authors to provide the clearer rationale of why using the two trajectories.
- The temporal activation section introduces onset, duration, strength, and a stepwise mask together. I suggest the authors to provide a short example that would help explain how these terms combine into one activation profile.
- Figure 4 is helpful, but it is unclear how temporal activation is set when each primitive is activated separately. I think the authors could provide a brief explanation and that would make the curves easier to interpret.
- The authors mentioned these datasets can be divided into forecast-based evidence and event-based evidence. However, which dataset belongs to the former and which belongs to the later? and what are their differences?
Questions for authors
See Weaknesses.
5 comments
Dear Reviewer 99pA,
Thank you again for your detailed and constructive comments. We have uploaded the revised manuscript, which incorporates the changes made in response to your suggestions and those of the other reviewers to improve the clarity and rigor of our work. We would be grateful if you could let us know whether our responses and revisions have addressed your concerns, and we will be glad to address any further feedback.
The authors have addressed my concerns, so I have raised my score.
Response to Reviewer 99pA
Thank you for the positive assessment and for recognizing our motivation, the separation between action activation and the persistence of its effects, and the comprehensive experiments. We apologize for the delayed response, as we conducted a substantial number of additional experiments to address the reviewers' concerns and further strengthen the paper. We have addressed your comments point by point below, and the revised manuscript incorporating these clarifications will be provided shortly.
W1: Definition of action and its relationship to external evidence.
In EGA-WM, an action represents a learned modification of the latent state transition, inferred from the historical state and external evidence. Formally, it is represented as a=(π,α,β,s,m), where π determines the combination of action primitives, while the remaining parameters control when and how strongly the action affects the state transition.
Importantly, external evidence serves as the input, whereas the action represents the response inferred from that evidence under the current system state. Thus, the same external evidence may lead to different inferred actions depending on the historical state. These actions are learned predictive representations rather than observed event labels or executable controls. We will clarify this definition and its relationship to external evidence in Secs. 3.3 and 3.4.
W2: Rationale for using two latent trajectories.
The two latent trajectories are designed to isolate the effect of action modulation while ensuring that the correction vanishes when no action is applied. Specifically, as defined in Eq. (10),
Y^=b+D(za)−D(z0),
both trajectories share the same initialization and baseline inputs, and are processed by the same decoder. Their only difference lies in whether action modulation is applied. The correction D(za)−D(z0) therefore captures the change in the decoded prediction associated with action modulation.
Importantly, when no action is applied, za=z0, making the correction exactly zero and recovering the original direct forecast b. In contrast, directly adding D(za) would alter b even without action modulation, since D(z0) is generally non-zero. We will clarify this rationale in Sec. 3.5 and refer to the corresponding proof in Appendix C.
W3: How temporal parameters form the activation profile.
The temporal activation combines four components: onset determines when the action begins, duration controls how long it remains active, strength determines its overall magnitude, and the mask adjusts the activation at individual forecast steps.
For example, consider a forecast horizon of H=6, where onset is concentrated at step 3, duration is concentrated at 3 steps, strength is s=2, and the mask is mh=0.5 for all steps. Under this simplified setting, Eq. (6) yields
g=(0,0,1,1,1,0).
The action is therefore activated during steps 3–5, with an amplitude of 2×0.5=1. This example uses concentrated onset and duration distributions for clarity, while the actual model learns soft distributions that allow more flexible activation profiles. Moreover, the action's effect may persist after activation through the latent state retention mechanism. We will include this illustrative example in Sec. 3.4.
W4: Temporal activation of individual primitives in Fig. 4.
In Fig. 4, all primitives are evaluated using the same inferred temporal activation profile. To visualize each primitive separately, we replace the primitive mixture weights with a one-hot vector while keeping the historical state, onset, duration, strength, mask, and frozen direct forecast unchanged. Each curve represents the resulting prediction adjustment relative to the direct forecast. We will clarify these visualization settings in the caption of Fig. 4.
W5: Distinction between the two types of external evidence.
Our experiments consider two types of external evidence: forecast-based evidence and event-based evidence. Their dataset assignments and examples are summarized below.
The key distinction lies in how the future evidence is obtained. Forecast-based evidence consists of predictions of external variables, such as future electricity load or wind generation. In contrast, event-based evidence provides records or known schedules of external events, including numerical variables such as prices.
Both types are provided to EGA-WM as numerical inputs under the benchmark assumption that the corresponding future covariates are available at the forecast cutoff. We will explicitly clarify this distinction and the dataset assignments in Sec. 4.1.