- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 3
Read review
Paper summary
This paper introduces relational equilibrium state estimation (RESE), an extension of equilibrium state estimation (ESE) [1] which circumvents the original method's need for attribute data by instead estimating relations between systems based on their past behaviour, and using this to estimate an equilibrium state. Once estimated, this equilibrium state is then used for future forecasting.
The main benefit of this method over ESE is that it does not require attribute data (which may not be present for the systems one is interested in) while still retaining similar or better predictive performance. However, the computational complexity (which is quadratic in the number of systems, as opposed to ESE which is linear) means that handling larger numbers of systems becomes rapidly more expensive, a fact which is mentioned but potentially not made as clear as it should be.
[1] B. Xu, A. Song, J. Gao, F. Liu, Once-for-All: Scalable Simultaneous Forecasting via Equilibrium State Estimation
Critical strengths
As presented, the method does what the authors claim: it removes the need for attribute data that is inherent in the design of ESE, while still retaining similar or better performance. Putting aside the computational complexity of this method, this is a clear benefit when working with time series that do not have accompanying attribute data.
Critical weaknesses
The paper is difficult to follow, immediately assuming familiarity with the work on equilibrium state estimation (ESE) from [1] (in fact, the authors don't make it clear that ESE is defined in [1], as it is referenced as a paper in which "equilibrium-state forecasting has been used for simultaneous prediction across multiple systems". Given that this work is an extension, the initial contribution of [1] should be presented more clearly).
Beyond that, terms are introduced that are not then discussed in detail until later (the relation between two systems is defined in terms of a transformation on page 2 that appears with no context, halfway down page 3 it is mentioned that the choice of determines how differences between systems are represented, but no actual candidate transformations are discussed until the appendix). Similarly the estimators are introduced in equation (5) but the details of them are postponed until the appendix, where I feel that at least one example should be given here to aid clarity.
As it stands, I feel that the paper requires [1] to be read in parallel to understand its motivations, which is a significant weakness. More careful explanation of what is being done, how it differs from ESE and some justification as to why we would want to use equilibrium-based methods should be added.
The computational complexity of the algorithm should probably be made more prominent. Several of the tables have potentially misleading captions referring to computational costs being close to ESE but better than the baselines, when this may simply be due to the small number of systems being used (as the complexity is where is the number of systems). The authors do note at points that it is more costly than ESE at larger numbers of systems (as well as mentioning the complexity) but I feel this should be made clearer. Tables containing larger numbers of systems (for which the runtime is noticeably worse) are left to the appendix. As it stands I would like to see efforts to reduce the complexity (I feel that comparing all possible pairs of systems is probably unnecessary, and one could be more thoughtful about selecting suitable comparisons).
Questions for authors
-
The forecasting results in Section 4.1 are essentially the same experiments as in the original ESE paper, but I notice that in the currency exchange and Covid-19 experiments two baselines (FiLM and KVAE) which appear in that paper are not considered here. Is there a reason for this?
-
The reliability weights seem only to depend on the pair and the historical data set used for validation, which presumably is fixed, so the weights appear to me to be constant in . Is this the case or am I misunderstanding? Also (unless it's implicit in the estimator) the calculation of these weights seems to give every past piece of historical data equal precedence - do things change if instead we pay more attention to the most recent data?
-
You mention in the future work section about using parallel computation to improve performance. While this would make the method run faster, it doesn't really reduce the complexity. Do you have any thoughts about doing the latter (for instance, you could potentially just restrict to the top most similar systems based on the historical data and then take relational estimates on those, and see if that makes any difference to the equilibrium state estimates).
4 comments
Responses to Questions 1 - 3
Q1. Why were FiLM and KVAE omitted from the exchange-rate and COVID-19 comparisons?
Thank you for the question. Our baseline selection was intended to cover a broad range of forecasting approaches, including statistical, recurrent, linear, graph-based, and Transformer-based models, rather than reproduce the entire baseline set of ESE. We therefore focused on a compact but diverse set of established and recent methods. FiLM and KVAE were not included in the initial comparisons as part of this selection, rather than because of any incompatibility with RESE.
Nevertheless, both models can be integrated into RESE as aggregate predictors. We are open to including their results in the revised manuscript to provide a more complete comparison with the original ESE study.
Run FiLM+RESE and KVAE+RESE on the exchange-rate and COVID-19 tasks using the settings and metrics of the existing comparisons. Present the standalone and ESE values from ESE alongside the new RESE values; verify comparability before reusing those numbers.
| Model | Base RMSE / MAE | RESE RMSE / MAE | RESE runtime (min) | |
|---|---|---|---|---|
| Exchange rates (16 systems) | FiLM | 5.93/5.54 | 5.52/5.27 | 0.70 |
| Exchange rates (16 systems) | KVAE | 6.05/5.59 | 5.45/5.16 | 0.51 |
| COVID-19 (20 systems) | FiLM | 76.84/73.85 | 72.83/69.84 | 0.86 |
| COVID-19 (20 systems) | KVAE | 70.85/64.44 | 73.42/68.36 | 0.67 |
| COVID-19 (79 systems) | FiLM | 56.21/51.34 | 52.03/50.46 | 4.31 |
| COVID-19 (79 systems) | KVAE | 53.12/52.71 | 51.93/50.27 | 4.12 |
| COVID-19 (320 systems) | FiLM | 5.74/4.96 | 4.49/4.13 | 58.45 |
| COVID-19 (320 systems) | KVAE | 5.29/4.94 | 4.57/4.20 | 57.97 |
Q2. Are the reliability weights constant in time? Would placing more weight on recent history change the results?
Regarding the time dependence of the weights, your interpretation holds when the validation set and relation scale are unchanged. In the selection-locked evaluation protocol, reliability weights are calibrated using pre-test data and retained during test forecasting. However, the relation models are refitted at each forecast origin using the available history (Appendix G.1, lines 1097–1109), so their predictions and the resulting equilibrium state continue to evolve. The framework also permits recalibration of reliability weights when new historical information becomes available. We have clarified the evaluation protocol and the notation in Eq.6.
Regarding the influence of recent data, Eq.5 gives equal weight to errors across the selected validation origins, but this does not mean that all past observations receive equal consideration. The implementation supports sliding historical windows and limits on the number of recent validation origins (Appendix G.1, lines 1097–1109). Thus, older observations can be excluded from both model fitting and reliability calibration. Assigning progressively greater weight to recent validation errors is another possible approach. It may change the selected models, reliability weights, and forecasts, although its effect on prediction accuracy has not yet been evaluated.
Q3. Could selecting the top- most similar systems reduce computation without materially changing the equilibrium estimates?
Thank you for this suggestion. Selecting a smaller set of system pairs is a reasonable way to reduce the computational cost of RESE.
The equilibrium estimation in Eq.7 does not require all possible pairwise relations. As discussed in Appendix C.1–C.5 (lines 897–959), the weighted reconciliation can operate on a subset of relations, with additional constraints when the resulting graph is disconnected.
Selecting the top- most similar systems before relation estimation could reduce the number of pairwise model fits from to , although the selection step introduces its own computational cost. The effect on equilibrium estimates depends on which relations are retained, since similarity does not necessarily imply predictive reliability.
We consider sparse relation selection a useful direction for improving scalability and have included it in our discussion of future work.
We hope the above response has fully addressed your comments. If so, we would greatly appreciate it if you could reconsider your rating.
Thank you for your response, the revised manuscript has sufficiently addressed my concerns regarding the paper's clarity and readability. My main concern about the computational complexity remains, however, as I feel that requiring relational estimates between every pair is unnecessarily crude and dramatically impacts the scalability of the method. I will therefore keep my score unchanged.
Thank you and further clarification on complexity and scalability
Thank you for your follow-up and for acknowledging the improvements in the manuscript.
The use of a complete relation graph is a modeling choice rather than a requirement of RESE. As established in Appendix C.2–C.3, a connected graph is sufficient to identify the relative coordinates up to a common offset. In particular, a spanning tree requires only edges, compared with in a complete graph. If such a graph is selected efficiently before model fitting, the number of pairwise estimation tasks can be reduced from to , making linear scaling with possible for this stage.
We would also like to clarify that estimating all pairwise relations is a deliberate modeling choice rather than a simple and crude approach. Cross-system relationships can be complex, heterogeneous, and time-varying, making it difficult to determine in advance which pairs are informative. RESE therefore estimates these relations individually and uses historical validation errors to assign reliability weights, allowing more predictable relations to contribute more strongly to the equilibrium estimation. The additional relations also provide more information for reconciling potentially inconsistent forecasts. Using fewer relations may affect estimation accuracy.
Quadratic computational growth is not unique to RESE. Explicit cross-variable modeling in methods such as iTransformer - [1], TPGNN - [2], and TQNet - [3] also involves operations that scale quadratically with the number of variables. Other methods face computational costs that grow quadratically along different dimensions, including PatchTST - [4], GTR - [5], and RAFT - [6] for historical retrieval preprocessing). These expressions describe the relevant computational components rather than the full training complexity. Thus, the quadratic computational cost arises from the complete relation graph used in the current implementation, rather than being an inherent requirement of the RESE equilibrium formulation. Using fewer relations may affect estimation accuracy, since the additional edges provide more information for reconciliation.
[1] Yong Liu, Tengge Hu, Haoran Zhang, Haixu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. (2024). iTransformer: Inverted Transformers Are Effective for Time Series Forecasting. International Conference on Learning Representations (ICLR 2024).
[2] Yijing Liu, Qinxian Liu, Jian-Wei Zhang, Haozhe Feng, Zhongwei Wang, Zihan Zhou, and Wei Chen. (2022). Multivariate Time-Series Forecasting with Temporal Polynomial Graph Neural Networks. Advances in Neural Information Processing Systems 35 (NeurIPS 2022).
[3] Shengsheng Lin, Haojun Chen, Haijie Wu, Chunyun Qiu, and Weiwei Lin. (2025). Temporal Query Network for Efficient Multivariate Time Series Forecasting. Proceedings of the 42nd International Conference on Machine Learning (ICML 2025), Proceedings of Machine Learning Research, 267:37797–37814.
[4] Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. (2023). A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers. International Conference on Learning Representations (ICLR 2023).
[5] Fanpu Cao, Lu Dai, Jindong Han, and Hui Xiong. (2026). Enhancing Multivariate Time Series Forecasting with Global Temporal Retrieval. International Conference on Learning Representations (ICLR 2026).
[6] Sungwon Han, Seungeon Lee, Meeyoung Cha, Sercan O. Arik, and Jinsung Yoon. (2025). Retrieval Augmented Time Series Forecasting. Proceedings of the 42nd International Conference on Machine Learning (ICML 2025), Proceedings of Machine Learning Research, 267:21774–21797.
Response to Weaknesses 1 - 4
We sincerely thank you for the reviews. Please see our responses below.
W1. Understanding RESE requires reading the original ESE paper.
We agree that the paper should explain more about ESE and have updated the manuscript.
ESE estimates a system-level equilibrium state using system attributes. RESE retains the separation of relative-state estimation and forecasting, but replaces the attribute-based equilibrium estimation with a relation-based one, hence requires no attributes.
The Introduction states the distinction and the underlying mechanism with a new Figure 1. Section 3.5 gives the reconstruction in Eq.9. However, these passages do not sufficiently explain the ESE framework on which RESE builds.
W2. The transformation T and the pairwise relation estimators are introduced without enough explanation.
We appreciate your suggestion to clarify these methodological details. Both the transformation and the pairwise relation estimators are further described in the updated manuscript, with their detailed formulations provided in Appendices A and B. We clarify their roles below and will add brief examples to the main text to make the presentation easier to follow.
Transformation T. As explained in Section 3.1 (lines 134–144), T determines how pairwise differences are represented. The main formulation uses T(s)=logs for positive observations, so that pairwise relations correspond to log-ratios of system values and their relative shares (Appendix A.1, lines 711–721). Other representations, including asinh, signed-log, and additive differences, are provided in Appendix A.3 (lines 733–746).
Pairwise relation estimators. Section 3.2 (lines 146–163) describes the historical validation and model selection procedure. Appendix B.1 (lines 756–856) specifies six candidate model families covering different relation dynamics. For example, the stable relation model predicts a pairwise relation using the median of its historical values, while other models capture trends, autoregressive dynamics, nonlinear patterns, and regime changes.
W3. The motivation for equilibrium-based forecasting is not sufficiently explained.
Thank you for raising this point. We clarified the motivation behind equilibrium-based forecasting in the updated manuscript as well as below.
The central idea is that the relative states of multiple systems are shaped by their interactions. ESE estimates the resulting equilibrium using system attributes that influence these interactions. For example, in exchange-rate forecasting, macroeconomic attributes such as GDP, inflation, and trade conditions provide information about the relative states of different currencies.
RESE follows the same motivation but approaches the problem from the observed outcomes of these interactions. Changes in the underlying attributes and their combined effects may be reflected in the historical relationships between system trajectories. Rather than explicitly modeling these attributes, RESE forecasts the evolving pairwise relations and reconciles them into a consistent equilibrium state (Sections 2–3, lines 105–132 and 148–186). The estimated state is then combined with the aggregate forecast to obtain individual predictions (Eq.9).
This allows RESE to retain the equilibrium-based forecasting framework while extending its applicability to systems without available or aligned attribute data. To clarify the motivation for equilibrium-based forecasting, we have added Figure 1 in Section 2, illustrating how the historical evolution of system values and their relative relations provides information for estimating future equilibrium states.
W4. The quadratic computational cost is understated, and the runtime comparisons may give a misleading impression.
The computational cost of RESE is explicitly discussed in Section 4.3 (lines 356–372), where Table 5 shows how pairwise relation estimation scales with the number of systems. Appendix G.5 (lines 1148–1168) further provides the complexity analysis. We also identify the quadratic growth in pairwise relations as a main limitation in Section 6 (lines 479–485).
The runtime comparisons in Section 4.1 are specific to their experimental settings. In particular, the observation that RESE has costs close to ESE refers to the 16-system exchange-rate experiment (lines 262–265), rather than a general claim across system sizes. The COVID-19 discussion (lines 267–275) explicitly notes that RESE becomes slower than ESE at 79 and 320 systems.
Nevertheless, we understand the concern that these limitations could be more visible alongside the main results. We have clarified the scope of the runtime comparisons and added the larger-system results from Appendix F more prominent in the main text.