- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PG-MoE framework merges and corrects ECMWF and NCEP GEFS ensemble outputs to predict typhoon tracks across multiple horizons. It relies on a Soft-Track module to translate ensemble paths into probability heatmaps and elliptical features, which are subsequently handled by frozen, physically grouped MLP experts under a hierarchical sparse router. In benchmarks covering 2024–2025 Northwest Pacific typhoons, the model beats evaluated baselines in 18 of 20 year–horizon pairs (e.g., cutting 48-hour errors from ECMWF's 91.59 km and 90.83 km down to 86.07 km and 86.79 km), with ablation studies supporting each architectural component. The results demonstrate improved typhoon track accuracy by combining ensemble-derived uncertainty descriptors with physically grouped experts.
Critical strengths
- The evaluation uses a subsequent-year test period, operational forecast baselines, and a broad set of component and architectural ablations. Table 2 reports improvements over ECMWF deterministic forecasts at several relevant horizons; for example, the 2024 48-hour error decreases from 91.59 km to 86.07 km. Together, the forecast comparisons and ablations provide useful evidence of the pipeline's predictive value and allow scrutiny of its individual design choices.
Critical weaknesses
- The experiments do not establish a practical advantage for hierarchical routing or separate expert specialization from increased model capacity.
Table 6 shows that Flat-R has lower mean track error than PG-MoE at 9 of 10 horizons in 2024 and 6 of 10 in 2025. These comparisons concern reported means, not established statistical significance, but they do not support an accuracy advantage for hierarchical routing. Appendix B.2 instead emphasizes more balanced activation and more stable routing accuracy. Balanced expert utilization is not itself a forecasting objective, and no corresponding practical benefit is established. The claim that hierarchical routing is essential for robust long-term generalization is therefore insufficiently supported.
The Single-E comparison in Table 4 does not resolve the capacity question. Section 4.4.1 claims matching "activation compute", but does not provide Single-E's exact architecture or numerical parameter counts. A single MLP matched to the total parameter count of the expert bank and routers is an important missing baseline. The practical benefits for enabling MoE for such small networks are hardly justifiable (lower VRAM requirement, lower latency etc.). Thus a comparison at this total capacity is important for testing whether physical specialization adds value beyond a larger prediction network.
- The Soft-Track representation and physical partitions are insufficiently specified and validated.
Table 10 provides limited evidence that preserving the full ellipse geometry improves prediction. Despite the information loss discussed in Appendix B.6, four boundary points remain competitive with six and eight, and achieve the lowest 120-hour error in both test years. Comparisons using only the center, as well as the center and covariance of the Gaussian (5 DoF in total), would help establish how much the uncertainty representation contributes beyond the estimated center.
Section 3.2 motivates the expert boundaries using physical guidelines, but their effect on prediction accuracy is not directly tested. Appendix B.3 compares using buffers with removing them, without varying the boundaries or buffer widths. Since physical partitioning is a central contribution, comparisons with nearby thresholds or alternative partitions would help establish whether the chosen divisions are beneficial and how sensitive the results are to these choices.
Questions for authors
-
What practical benefit justifies choosing hierarchical routing over the simpler flat router? Flat-R achieves lower mean errors in 15 of the 20 comparisons in Table 6. More balanced expert activation alone does not establish a useful advantage for this small forecasting model. What evidence shows that the added routing complexity benefits the forecasting task?
-
Capacity and ablation controls: What is Single-E's exact architecture, and how is "activation compute" matched? Please report parameter counts and compare forecast accuracy against a single prediction network matched to the total parameters of the experts and routers. For Dense-MoE, what exactly is the setup of this experiment? For Table 7, do Top1 and Top2 retain the same expert bank and change only the number selected per group?
-
Soft-Track input, supervision, and representation: How are the input and target of the FCN constructed? Please clarify whether the FCN is trained separately and held fixed for subsequent MoE training. Please also compare sampled ellipse points with direct center-covariance features mentioned in the weakness.
-
Physical partition validation: How sensitive are the results to changes in the Table 1 boundaries and buffer widths? Do the physically motivated boundaries improve accuracy over nearby thresholds or alternative partitions, such as equal-frequency bins, with the same expert architecture?