- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MrSOP, a single multi‑regime orbit forecasting model combining physics‑anchored routing and tensor‑train decomposed mixture‑of‑experts. A large‑scale TLE‑derived dataset covering LEO/MEO/NSO/GEO is constructed. It achieves strong zero‑shot forecasting results on real held‑out satellite precise ephemerides with greatly reduced parameter count via DMoE. The work demonstrates promising application‑level progress for satellite orbit prediction, though several gaps remain between the experimental setup and real‑world space‑situational‑awareness deployment.
Targeting satellite orbit prediction across multiple orbital regimes including LEO, MEO, NSO and GEO is a relatively novel angle. Based on this merit, I am inclined towards a positive evaluation. Nevertheless, the authors must provide reasonable responses to the concerns I have raised.
Critical strengths
-
The paper targets multi‑regime satellite orbit prediction covering LEO, MEO, NSO and GEO within a single model, which is a relatively novel setting. Its Mixture‑of‑Experts‑based (named DMoE, i.e. Decomposed Mixture‑of‑Experts) design is explicitly motivated by heterogeneous orbital dynamics across different regimes: the MoE backbone provides a pool of experts to fit distinct dynamical patterns, and physics‑anchored routing dispatches inputs to suitable experts using physically derived orbital‑element coordinates. The “Decomposed” part refers to tensor‑train weight decomposition purely for parameter compression and does not alter the multi‑regime routing logic. This avoids training separate models for each orbital regime and does not require regime labels at inference time.
-
A large‑scale TLE‑derived dataset of 18,004 satellites across four orbital regimes is carefully constructed. Critically, zero‑shot evaluation is performed on held‑out real‑world precise ephemerides completely unseen during training, which improves experimental rigor compared with many orbit‑prediction works.
Critical weaknesses
-
The dataset suffers from severe imbalance in satellite counts among different orbital regimes. Despite DMoE seeming to be a promising approach for multi‑regime satellite orbit prediction, several issues remain unaddressed. These include the criterion for selecting the number of experts, the mitigation strategy for cross‑regime data‑distribution imbalance, and the justification for hard‑coding activation of two experts per input window rather than 1, 3 or alternative values.
-
DMoE achieves massive parameter compression accompanied by noticeable accuracy improvement instead of performance drop. This can be attributed to either overfitting in the original full‑rank MoE or implicit low‑rank regularization brought by tensor‑train decomposition. Unfortunately, the paper only reports empirical metrics, without diagnostic experiments to separate these two effects or supporting theoretical analysis.
Questions for authors
- Different orbital regimes are governed by distinct dominant perturbation forces. How does your model handle fundamentally different dynamics, given that you only route via (log\ a,e) and do not embed explicit perturbation physics inside experts? Why does it fail on some GEO zero‑shot samples?
- The paper fixes temperature \tau=0.15 and top‑2 expert selection. There is no ablation study varying \tau or the number of activated experts per forward pass. These are critical heuristic design choices; how sensitive is performance to these hyperparameters?
- Why top‑2? Would top‑1 or top‑3 or others yield better or worse forecasting quality, especially for boundary orbital states between regimes?
- The dataset is heavily imbalanced: LEO dominates sample count, while MEO, NSO and GEO contain far fewer trajectories. Could the large volume of LEO data dominate training? Can MEO/GEO‑related experts learn meaningful patterns with limited gradient signals?
- DMoE improves accuracy after heavy parameter compression. Is this caused by full‑rank MoE overfitting or implicit low‑rank regularization from tensor‑train decomposition? Could you provide experiments or analysis to tell them apart?
3 comments
Q2 & Q3. Routing sensitivity and the choice of two active experts
Default configuration and sensitivity. Our default configuration, with top-2 routing, gives the lowest test-average error and the lowest seven-set average in both separate sensitivity sweeps. The seven-set average is 175.957 km, supporting one common configuration across regimes. Changing to 0.05 or 0.5 increases the test-average error by at most 3.3%. Using top-1, top-3, or top-4 increases it by at most 4.2%.
Routing temperature. gives 192.2 km test Pos3D MAE, compared with 198.6 km at 0.05 and 198.0 km at 0.5 (Table B).
Table B. Routing temperature: Pos3D MAE (km), 10-epoch budget, seed 42. Avg. is the arithmetic mean of the seven reported regime/dataset errors, with equal weights and excluding Test: all.
| Avg. | Test: all | LEO | MEO | NSO | GEO | Zero-shot: Starlink | Zero-shot: GNSS | Zero-shot: BeiDou | |
|---|---|---|---|---|---|---|---|---|---|
| 0.050 | 187.214 | 198.600 | 199.600 | 197.600 | 243.900 | 178.400 | |||
| 0.150 (default) | 175.957 | 192.200 | 139.200 | 96.700 | 204.600 | ||||
| 0.500 | 204.100 | 227.100 | 186.700 | 174.600 | 98.200 | 242.600 | 113.900 |
Activated experts. Top-2 gives 192.200 km test Pos3D MAE, compared with 199.400, 200.200, and 197.450 km for top-1, top-3, and top-4, respectively (Table C).
Table C. Activated experts per window (top-): Pos3D MAE (km), 10-epoch budget, seed 42. Avg. uses the same seven-set arithmetic mean as Table B.
| Top-k | Avg. | Test: all | LEO | MEO | NSO | GEO | Zero-shot: Starlink | Zero-shot: GNSS | Zero-shot: BeiDou |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 199.400 | 206.100 | 230.600 | 143.100 | 217.800 | 92.100 | 208.800 | 150.900 | |
| 2 (default) | 175.957 | 192.200 | 200.000 | 206.400 | 139.200 | ||||
| 3 | 182.614 | 200.200 | 208.900 | 244.900 | 106.800 | 239.800 | 110.600 | 198.100 | 169.200 |
| 4 | 183.680 | 235.890 | 100.240 | 215.620 | 180.570 |
Why top-2, including boundary states? Top-2 combines the lowest test-average error in this sweep with the ability to blend two expert representations near routing boundaries. Individual regimes favor different settings. Table D under Q4 reports aggregate expert utilization. The ablations do not separately measure forecast errors on boundary windows.
We will add the temperature and top- ablations to Appendix D and summarize their findings in Section 5.2 (Ablation Study).
Q4. Regime imbalance and learning in smaller regimes
Learning across unequal regimes. Square-root sampling assigns LEO a sampling probability of 49.7%, compared with its 70.4% share of available windows. Under the same total training-window budget, MrSOP also outperforms separately trained models in the smaller regimes, including MEO and GEO.
The sampler draws regimes in proportion to the square root of their window counts, raising MEO's sampling probability from its 1.4% data share to 6.9%.
Learning in smaller regimes. Routing weights experts by distances to anchors in space, while shared TT cores receive training signals across regimes. Table D shows distinct dominant experts for LEO, NSO, and GEO, with MEO using several experts.
Table D. Expert utilization by regime for MrSOP with seed 42. Values are shares of the regime's routed gate weight in the last MoE layer.
| Regime | Experts receiving > 1% of the regime's gate weight | # experts above 1% |
|---|---|---|
| LEO | e3 (100.000%) | 1 |
| MEO | e6 (85.300%), e2 (5.700%), e11 (4.600%), e14 (3.700%) | 4 |
| NSO | e11 (100.000%) | 1 |
| GEO | e13 (100.000%) | 1 |
Per-regime evidence. Under the same total training-window budget, MrSOP outperforms four separately trained TimeMixer models in every regime, including MEO (206.4 vs. 360.3 km) and GEO (222.7 vs. 475.1 km), measured as test Pos3D MAE with a 10-epoch budget and seed 42. TimesFM [5] and Chronos-2 [6] also learn from heterogeneous collections of unequal size. Our sampling and per-regime results provide the evidence for MrSOP.
We will specify the sampling probabilities in Section 4 and add the expert-utilization and per-regime comparisons to Appendix D.
References
[1] Montenbruck, O., and Gill, E. Satellite Orbits: Models, Methods and Applications. Springer, 2000. https://doi.org/10.1007/978-3-642-58351-3.
[2] ESA Space Debris Office. ESA's Annual Space Environment Report, Issue 10.1, 2026. https://www.sdo.esoc.esa.int/environment_report/Space_Environment_Report_latest.pdf.
[3] Rosengren, A. J., Skoulidou, D. K., Tsiganis, K., and Voyatzis, G. Dynamical cartography of Earth satellite orbits. Advances in Space Research, 63(1), 443–460, 2019. https://doi.org/10.1016/j.asr.2018.09.004.
[4] Daquin, J., Rosengren, A. J., Alessi, E. M., Deleflie, F., Valsecchi, G. B., and Rossi, A. The dynamical structure of the MEO region: long-term stability, chaos, and transport. Celestial Mechanics and Dynamical Astronomy, 124(4), 335–366, 2016. https://doi.org/10.1007/s10569-015-9665-9.
[5] Das, A., Kong, W., Sen, R., and Zhou, Y. A decoder-only foundation model for time-series forecasting. Proceedings of the 41st International Conference on Machine Learning, PMLR 235, 10148–10167, 2024. https://proceedings.mlr.press/v235/das24c.html.
[6] Ansari, A. F., et al. Chronos-2: From Univariate to Universal Forecasting. arXiv:2510.15821, 2025. https://arxiv.org/abs/2510.15821.
We thank the reviewer for recognizing the unified multi-regime design and the evaluation on unseen ephemerides.
W1. Expert configuration and regime imbalance
Expert count. In Appendix E (Effect of the Number of Experts, lines 1109–1120), sixteen experts give the lowest Starlink and GNSS errors among the tested expert counts while using fewer parameters than 32 experts. Varying E over 4, 8, 16, and 32 gives in-domain Pos3D MAE of 151.35–160.40 km (E denotes K in the paper). Increasing from 16 to 32 raises parameters from 1.96 M to 3.59 M without improving either zero-shot result, supporting 16 as the common configuration.
W2 & Q5. Why TT improves accuracy under compression
Why accuracy improves under compression. Table A supports a contribution from TT's implicit low-rank regularization. TT constrains the expert weights while retaining full-width experts. Compared with the original full-rank MoE, TT has comparable training MAE and lower validation and test errors.
Matched parameter budgets. TT achieves 192.2 km test Pos3D MAE with 1.96 M parameters and expert width 1,024. The narrow full-rank control achieves 197.6 km with 1.97 M parameters and width 52. TT also has lower training and validation errors than this control.
Compression and rank choice. The original full-rank MoE requires 33.85 M parameters and has 248.7 km test error. Among TT ranks 8, 16, 32, and 64, rank 32 gives the lowest validation and test errors.
Table A. Rank sweep and parameter-matched control. Train and Val MAE average errors over six channels in normalized units. Test error is Pos3D MAE (km). In all comparison tables, bold marks the lowest error and underlining marks the second-lowest.
We will add the rank sweep and parameter-matched comparison to Section 5.2, with training and validation diagnostics in the appendix.
Q1. Different orbital dynamics and GEO zero-shot performance
Handling different orbital dynamics. MrSOP uses (loga,e) to select and weight experts, while each expert predicts from the position–velocity history. Experts learn temporal patterns from these histories and can capture the signatures of perturbations represented in the training trajectories. Inputs with similar routing coordinates can therefore produce different forecasts. Shared TT cores support learning across regimes.
Why route with (loga,e)? We use (loga,e) as a compact physical coordinate pair for expert routing. Semi-major axis and eccentricity are established descriptors of orbital size and shape [1]. They determine the perigee and apogee heights used in ESA's altitude-based definitions of LEO, MEO, and HEO [2, Table 1.2]. Their use follows established a–e dynamical maps at specified inclinations [3, Section 3.3]. We use log10(a/km) to reduce scale differences between low and high orbits before standardization. These coordinates guide expert selection, while each expert predicts from the full position–velocity history.
Additional routing coordinates. Other orbital elements can refine distinctions within a regime. Inclination, for example, enters ESA's GEO and NSO definitions [2] and affects long-term lunisolar dynamics [4]. Section 6 (Discussion, lines 518–520) identifies inclination as a future routing coordinate. The current experts retain orbit-specific information through the full state history.
GEO zero-shot performance. Similar semi-major axes and near-zero eccentricities can make GEO trajectories difficult to distinguish in (loga,e) space. This may limit routing specialization within GEO and contribute to lower accuracy on unseen GEO satellites. Inclination is not an explicit routing input, so small orbital-plane differences among near-equatorial trajectories are represented through the full position–velocity histories.
Performance across regimes. Nevertheless, in the paper's main comparison (Table 3), MrSOP achieves the lowest BeiDou error among learned models and ranks second to SGP4 on this eight-satellite GEO cohort (Appendix B.3). Across the main Tables 2–3, MrSOP achieves the lowest errors on Starlink, GNSS, and all four in-domain regimes, using one model without regime-specific retraining or regime labels at inference.
We will add this coordinate-selection rationale and its supporting references to Section 3.2 (Physics-anchored Routing).