- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
RAL-MoE-ROM is a novel reduced order approximation method that combines regime-local POD–Galerkin models with sparse mixture-of-experts corrections and history-conditioned, physical-space fusion. The authors provide experiments that cover three fluid flow geometries; cross-regime fusion is tested on prescribed steady–Hopf and Hopf–periodic overlaps.
Critical strengths
- Interesting approach to an important problem. I find it clever that each specialist uses its own POD basis. This way, fusion after physical reconstruction avoids aligning incompatible local reduced coordinates.
- The author provide a broad comparison accros a range of methods: POD–Galerkin, OpInf, recurrent, FNO, ql-ROM. Also, architecture ablations provide useful evidence for the reported gains (Tables 1–2 and 6).
Critical weaknesses
- The biggest concern in my opinion is that authors perform manual regime pairing (i.e., overlapping regions and candidate specialist pairs are prescribed), so fully automatic regime selection is not demonstrated (Section 4.2). Ideally, the system should determine which specialist or combination of specialists is applicable to a new physical parameter. This significatly weakens the methods.
- Despite Table 3, I find the validation narrow. For instance, each interface uses only two Reynolds numbers and overlapping windows. A much extensive range of prameter should be considered to provide a clearer picture of the method.
- The inference cost remains quite high. It looks like the periodic specialist takes 3.32x the Dense baseline's inference time despite sparse activation (Table 12). This is particularly concerning given that reduced-order modelling is motivated by computational efficiency.
Questions for authors
These are related to the weaknesses above, in the same order:
- Can the full system identify applicable specialists without manually supplied pairs?
- Do the gains in Table 3 persist across more unseen Reynolds numbers and longer rollouts?
- Is Table 12 a typo ? If not, then did the authors consider improving the accuracy and computational efficiency compared to denser baselines?
6 comments
Comment 1: The biggest concern in my opinion is that authors perform manual regime pairing (i.e., overlapping regions and candidate specialist pairs are prescribed), so fully automatic regime selection is not demonstrated (Section 4.2). Ideally, the system should determine which specialist or combination of specialists is applicable to a new physical parameter. This significatly weakens the methods.
Question: Can the full system identify applicable specialists without manually supplied pairs?
Response: Thank you for highlighting this concern. Within the available model family, the revised evaluation selects applicable specialists without manually supplied interface-specific pairs. We now evaluate E2 without the interface-specific pair mask: it determines which eligible specialists participate and whether prediction uses one or two. The regime-local POD representations and chart-assigned training labels remain physically prescribed; the added experiment establishes automatic selection within this model family, rather than automatic discovery of regime boundaries.
For , E2 provides preferences . Among eligible specialists, it selects the highest-ranked one when the maximum preference is at least , and otherwise selects the two highest-ranked specialists (Section 3.4, Eq. (18), p. 6). Eligibility requires the projected operators and initialization from the prescribed physical history. A single specialist predicts directly. When an adjacent pair is selected, both specialists encode the same initial history in their own coordinates and evolve independently; their corresponding frozen T2-C gate combines the reconstructed fields. Selection is parameter-only, while the fusion weight also uses the initial three physical states. The selected set and weight remain fixed throughout the rollout (Section 3.4 and Appendix C).
We compare E2 with two alternatives while retaining identical frozen specialists and pair-specific T2-C gates. Reynolds-number thresholding uses fixed transition centers and half-widths : it selects S--H in , H--P in , and a single specialist elsewhere. Candidate rules first maximize the number of fully evaluable parameters and then minimize the equally weighted mean joint error across Reynolds numbers. Validation-based selection instead measures each admissible configuration's mean autonomous prediction error at calibration parameters, selects the minimum-error configuration there, and assigns it to a target parameter by nearest-neighbor lookup. Calibration and evaluation trajectories are separate. Appendix F.6, Eqs. (66)--(70) and Table 11 (p. 26), define both baselines. The gates retain their original E2 pair-preference and initial-history inputs, so this comparison changes specialist participation, not the fusion mechanism.
E2 selects two specialists for 27/38 Circular, 27/38 Square, and 30/44 Pinball configurations, corresponding to , , and (Table 12, p. 27). More importantly, it has the lowest mean full-window joint error, , in all 15 benchmark--horizon comparisons (Table 13, p. 28). These results demonstrate predictive value beyond simply activating two specialists: E2 coordinates independent local ROMs more effectively than the two tested selection alternatives, without requiring a manually supplied interface-specific pair.
Comment 2: Despite Table 3, I find the validation narrow. For instance, each interface uses only two Reynolds numbers and overlapping windows. A much extensive range of prameter should be considered to provide a clearer picture of the method.
Question: Do the gains in Table 3 persist across more unseen Reynolds numbers and longer rollouts?
Response: Thank you for highlighting the narrow original validation. We now distinguish the controlled fixed-pair fusion comparison from a broader automatic-selection evaluation and a separate long-horizon interface study. This allows us to assess broader predictive gains without treating additional overlapping windows as independent trajectories.
The original 16 windows per interface comprise eight overlapping windows from each of two Reynolds-number trajectories. Holding specialist predictions fixed isolates the fusion rule: T2-C reduces joint error from to at S--H and from to at H--P, approximately and reductions relative to E2 Top-1 (Table 3, p. 8). It also outperforms equal blending, E2-probability weighting, and training-fitted constant-weight and logit-offset controls. The architecture-matched history ablation gives and reductions relative to the history-ablated gate, supporting the value of initial-history information (Appendix F.1, Figure 2, pp. 18--19).
The expanded evaluation covers 38 Circular, 38 Square, and 44 Pinball parameter configurations. The autonomous horizons are , , and , respectively. Each geometry uses its own specialists and gates; within each benchmark, the three selection methods share identical frozen specialists and T2-C gates. E2 has the lowest mean joint error in all 15 benchmark--horizon comparisons. Its longest-horizon errors are , , and , respectively (Section 4.2; Appendix F.6, Table 13, p. 28). Equal output-step counts do not imply equal physical durations across benchmarks.
The separate direct fusion study uses twelve Square trajectories, six per interface, at (); four extend to (). At , T2-C's H--P joint error is , below Periodic () and Hopf (). At S--H, the errors are for T2-C, for Steady, and for Hopf. Thus, H--P fusion gains persist in this study, while Hopf remains preferable at S--H. Appendix F.5, Table 10, and Figures 6--7 (pp. 23--25) report the direct comparisons and trajectory-resolved energy and nonlinear-residual diagnostics.
The expanded evidence supports history-conditioned fusion beyond simple weighting and the aggregate predictive contribution of E2 over broader parameter evaluations and longer autonomous rollouts. We report the interface dependence of direct fusion separately, rather than equating the routing comparison with uniform superiority over the best individual specialist. This provides a clearer account of where coordinated local ROMs improve prediction.
We sincerely thank the reviewer for identifying three central questions concerning automatic specialist selection, the breadth of validation, and computational efficiency. The revised experiments provide evidence that RAL-MoE-ROM can determine specialist participation without manually supplied interface-specific pairs, retain aggregate predictive benefits over broader parameter evaluations and longer rollouts, and achieve lower measured inference latency than the matched Dense control.
To address manual regime pairing, we removed the interface-specific pair mask and evaluated E2 selection of one or two eligible specialists from the constructed regime-local model family. With identical frozen specialists and T2-C gates, E2 achieves the lowest mean joint error in all 15 benchmark–horizon comparisons against Reynolds-number thresholding and validation-based selection. This demonstrates that automatic specialist selection contributes to prediction accuracy, rather than merely assigning weights to a prescribed pair.
The evaluation now covers 38 Circular, 38 Square, and 44 Pinball Reynolds-number configurations, with autonomous routing comparisons extending to K = 512 on Square. E2 retains the lowest mean joint error throughout these comparisons. A separate study evaluates fusion on twelve Square interface trajectories at K = 512, with four extended to K = 1024. At K = 512, T2-C improves on both individual specialists at H–P, while Hopf remains more accurate at S–H; the expanded results therefore support broader aggregate predictive benefits while identifying the interface dependence of long-horizon fusion.
Regarding computational efficiency, the original 3.32× ratio resulted from inconsistent timing scopes rather than a typographical error, and we have removed that comparison. With the revised implementation and matched outer prediction configurations on Square, RAL-MoE-ROM is faster than the total-parameter-matched Dense control, including a 22.71% latency reduction under adaptive T2-C at K = 48. The separate accuracy comparison gives approximately 16.0% and 32.4% lower velocity and pressure errors at the same horizon, supporting a favorable accuracy–cost trade-off. We provide the supporting experiments and manuscript locations in the detailed responses below, and for more detailed responses, please refer to the supplementary material Reply to Reviewer veAp.pdf.