- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how the order in which Mamba reads variable histories affects multivariate forecasting. The authors hypothesize that keeping the heterogeneous signals of the same physical component together improves prediction and propose a component-grouped ordering policy Across 100 matched seeds, the grouped policy yields lower test MSE than random orders.
Critical strengths
The paper studies how component-grouped variable orders influence Mamba-3 and evaluates whether they improve prediction on a nuclear power system.
The experiments on the nuclear system evaluate the proposed ordering policy under well-controlled conditions.
Critical weaknesses
The paper’s technical proposal is a single ordering variable by documented physical components, which is applied to a fixed Mamba-3 architecture.
Evaluation of a single simulated system. All results come from one simulated nuclear plant dataset. It is unclear whether the conclusion generalizes to other systems, and the title’s claim about “large-scale systems” is not supported.
Presentation. The figures are somewhat hard to interpret: Figures 2 and 4 pack many symbols and annotations into small panels.
Questions for authors
Several abbreviations are used without definition, e.g., GPS (in GPS-Mamba), NPPAD and SISO. Please define them at first appreances.
The Mamba-3 architecture is used without modification, so the contribution is limited to the input order. Does the benefit of component grouping also hold for other variable-token architectures (e.g., S-Mamba or Mamba-2)?
2 comments
[W3] Presentation, Figure, Abbreviations
Figures
Thank you for your contribution and sorry about it. We agree that Figures 2 and 4 packed too many symbols into small panels. We redrew both figures and added a new Figure 5 for the test in Section 5.2.
+Section 3.2 now explains the state update of the Mamba-2 and Mamba-3 item by item against Figure 2.
Abbreviations
We used the names given in the original papers and data sets and thought their names were not that important(especially NPPAD..), but the first explanation for readers unfamiliar with them was missing. Each is now explained where it first appears, with its source.
| Abbreviation | Meaning |
|---|---|
| GPS-Mamba | graph permutation scanning Mamba (Yao et al., 2026) |
| NPPAD | Nuclear Power Plant Accident Data (Qi et al., 2022) |
| SISO | single-input, single-output form of Mamba-3 |
We do appreciate your time!
[W1] Scope of the contribution
Scope of the contribution
The input order is a simple initial setting that can be changed without modifying the architecture. We did not stop at this result: we questioned where it comes from and tried to explain it with ablations. In the initial version that explanation was wrong, and Reviewer JC4u pointed it out, so we corrected it. Of course, the cause of the ordering advantage is not 'fully' resolved. Still, by presenting our hypotheses, results, and many experiments, we hope the question will eventually be resolved, and we would like this work to give the community that wants to use Mamba-type models on such systems something that "can bring a gain, while the change itself is easy."
Added systems and "large-scale"
We added four systems, and to support "large-scale", we included two small systems as a contrast group (table in the general response; Section 2.1, Table 1, Appendix A). Grouping lowers the error in the three systems with many variables and signal types, with both cores; in the two 17-variable systems, seven of the eight comparisons are not statistically significant. How the effect changes at sizes in between was not examined, and the limitations say so.
Mamba-2 and other architectures
We ran additional experiments with Mamba-2. We exchanged only the core of the same bidirectional predictor, kept the sizes and training budget the same (Table A3), and trained all five systems with the same 100 seeds per policy. As with Mamba-3, grouping helps in the three larger systems and not in the two small ones.
The pattern is the same as with Mamba-3, and the reductions are larger. Mamba-2 is more sensitive to order in four of the five systems (Appendix C.3, Figure C1), which is consistent with its short convolution that mixes each token with the three before it (Figure 2(b)). The output removal test on the nuclear test records gives the same result with Mamba-2 (Figure 4(c), Table D3). In addition(We would not say our contribution but still would like to report..), Mamba-3 has the lower error in all fifteen system-policy combinations (Table B2).