- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses multistep recursive forecasting of tokamak plasma dynamics, motivated by the finding that no single model is best across all physical variables and horizons, and that one-step accuracy does not predict full-rollout performance. The authors route among a frozen bank of heterogeneous experts, selecting one per physical head at each step, and compare four frameworks: behavior-cloning Baseline-MoE, DAgger-style DaD-MoE, PPO-MoE, and their proposed FIRE, which combines soft full-information supervision with KL-anchored rollout refinement. PPO-MoE performs best on simulated MAST-U data (6.38% below Baseline-MoE), while FIRE performs best on real MAST measurements (12.29% below the strongest fixed expert, 7.81% below Baseline-MoE). The results show that adaptive expert routing, evaluated on complete-rollout error, improves long-horizon multivariable forecasting in fusion-energy systems.
Critical strengths
The paper is well motivated, showing with evidence that no single predictor dominates across variables and rollout steps and that one-step rankings disagree with full-rollout rankings, which justifies both the routing approach and the full-rollout evaluation criterion. The evaluation is rigorous, spanning simulation and real MAST device data with strictly disjoint expert-training, router-training, validation, and test splits. The systematic comparison of four routing frameworks, all outperforming the strongest fixed expert on real data, is complemented by informative appendix analyses, including ablations, routing-entropy studies, and an honest negative transfer result.
Critical weaknesses
One center claim is that per-step adaptive routing improves recursive forecasting, but it never compares against the natural cheap alternatives: a static per-head expert assignment selected on validation rollouts, or simple output averaging/stacking of the experts. The “strongest fixed expert” reference uses one expert for all heads, which is a weak strawman given the paper’s own premise that experts specialize per variable. Without these baselines, it is impossible to tell whether the gains come from step-wise adaptivity (the contribution) or merely from per-head specialization that a trivial static policy would capture.
Questions for authors
The related-work discussion focuses on magnetic-confinement tokamak prediction. Fusion surrogate modeling also spans other regimes with similar challenges of data scarcity and timing-sensitive targets, such as ICF waveform prediction (e.g., "Decomposition-Guided Diffusion Language Models for Inertial Confinement Fusion Prediction" EMNLP), where physics-driven PPO rewards have likewise been used. Could the authors comment on whether the proposed routing framework, or the observation that one-step accuracy does not determine rollout quality, is expected to carry over to non-recursive fusion-prediction settings?
2 comments
Response to Reviewer 3Fez 2
2. Discuss how the routing framework and the insight that local accuracy may not reflect final task quality could extend to non-recursive fusion prediction, such as ICF waveform prediction.
Question for the authors
Thank you for this suggestion, which helps us broaden the discussion to a wider range of fusion prediction tasks. In Appendix A.11, “Limitations and Future Directions,” of the revised manuscript, we added a discussion of how the routing framework could extend to non-recursive prediction tasks such as inertial confinement fusion (ICF), and we cite the ICF-DLM paper there [1]. The revised manuscript identifies this extension as a direction for future work and notes that prediction quality could be evaluated using pointwise error, neutron yield, and peak timing.
Predicting ICF outcomes likewise involves limited experimental data and sensitivity to the timing of key events. The ICF-DLM study you mentioned directly predicts neutron production rate waveforms from laser pulses and target capsule parameters. It uses a physics-driven PPO reward that accounts for neutron yield, peak timing, and waveform fidelity, providing a useful reference for our discussion.
More generally, our study suggests that local prediction metrics may not adequately reflect performance on the physical task of interest. This insight also applies to how we evaluate non-recursive predictions. For example, when predicting a complete ICF waveform directly, average pointwise error alone may not capture how accurately the model predicts the timing and local shape of a brief emission peak or the integrated neutron yield. In both types of tasks, this motivates aligning model optimization and evaluation more closely with the physical objectives.
If complementary experts are available for a non-recursive task, the router could select experts based on inputs such as laser pulses and target capsule parameters. The router could then be optimized using physical metrics computed from the final combined prediction. This would require adapting the routing inputs, output structure, and training objectives to direct waveform prediction so that expert selection serves the goals of predicting waveform shape, peak timing, and neutron yield.
References
[1] Xiang Zhang, Varchas Gopalaswamy, Rahman Ejaz, Riccardo Betti, and Dongfang Liu. 2026. Decomposition-Guided Diffusion Language Models for Inertial Confinement Fusion Prediction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pp. 13567–13582, Budapest, Hungary. Association for Computational Linguistics. DOI: 10.18653/2026.findings-emnlp.646.
Response to Reviewer 3Fez 1
1. Add per-variable fixed-expert and expert-averaging baselines to assess whether dynamic routing provides additional gains beyond fixed per-variable specialization.
Main weakness
Thank you for this suggestion. The single fixed-expert baseline in the original manuscript used the same expert for all physical quantities. In the revised manuscript, we added two baselines, Static per-head and Uniform average, to compare fixed per-variable expert specialization and simple output averaging with dynamic routing.
For Static per-head, we first select the best-performing expert for each physical quantity based on each expert’s full-rollout validation error. We then keep this assignment fixed throughout recursive forecasting on the test set. At each step, the designated experts generate predictions for their respective quantities. We assemble these predictions into a complete state and feed it back into the next step. This allows different physical quantities to use different experts while keeping the assignment fixed across forecast steps. For Uniform average, all experts receive the same current state at each step. We average their predictions with equal weights for each physical quantity, assemble the resulting state, and feed it back into the next step.
These results have been added to Tables 1–6 of the revised manuscript. Appendix A.4 of the revised manuscript describes the experimental settings.
Response Table 1. New baseline results on simulated MAST-U (relative ℓ2 error)
Response Table 2. New baseline results on experimental MAST (pooled NRMSE)
Over complete rollouts on experimental MAST, FIRE reduced Macro NRMSE by 7.88% and 6.72% relative to Static per-head and Uniform average, respectively. Over complete rollouts on MAST-U, PPO reduced the Macro relative ℓ2 error by 3.05% and 2.47% relative to those two baselines, respectively. These comparisons show that, under the settings evaluated in this study, dynamic routing provides further gains in recursive forecasting beyond fixed per-variable expert specialization and simple output averaging.