- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper targets long‑horizon LEO orbit forecasting for non‑cooperative space objects such as satellites, rocket bodies and debris. It proposes DynaBR, a hybrid physics‑data framework composed of three modules: Global Dynamics Reference, Local Dynamics Alignment (LDA), and Dynamics‑Conditioned Residual Forecasting. The core contribution is LDA, which calibrates phase drift via linear fitting of historical phase discrepancies in the RTN frame and reduces long‑horizon error substantially.
The authors build a large dataset from real TLE archives by propagating discrete TLEs into regularly sampled time series using SGP4. Train/val/test splits are object‑disjoint to evaluate generalization to unseen targets. Experiments compare DynaBR against pure physics baselines and many time‑series deep learning models across forecast horizons up to 48 hours. Ablations verify the effectiveness of each component, especially LDA. Case studies on ISS conjunction assessment demonstrate downstream application potential.
Critical strengths
-
It addresses a critical pain point in orbit forecasting: approximate dynamical models produce time‑accumulated orbital phase drift, which causes error explosion in long‑horizon forecasting. Instead of directly estimating hard‑to‑obtain physical parameters (area‑to‑mass ratio, attitude), it fits the linear trend of phase discrepancies from historical orbital time‑series, and applies rotational correction to future reference orbits within the local RTN orbital frame.
-
The paper builds a large‑scale LEO dataset covering satellites, rocket bodies and space‑debris with object‑disjoint evaluation.
Critical weaknesses
-
While the paper states that it targets non‑cooperative space objects, all validation experiments are performed on data simulated and generated by the SGP4 propagator. It appears that all train/val/test trajectories are reconstructed by propagating discrete TLEs with SGP4. Thus, both inputs and ground‑truth labels are SGP4 outputs instead of real‑world physical orbits. The model may fit SGP4‑specific artifacts and biases rather than true unmodeled orbital perturbations. No held‑out independent precise ephemeris is used to test out‑of‑SGP4 generalization, leading to considerable simulation‑to‑reality risk. Additionally, the dataset produces ideal dense uniform time‑series and ignores noise from real‑world orbit‑determination pipelines; reported performance may drop under real operational inputs.
-
I cannot see the LEO dataset released.
Questions for authors
-
It is clear that the dataset is filled‑in from TLE records via the SGP4 propagator. Why is the latter barely mentioned in the main text?
-
Does the manuscript suffer from substantial instances of the following writing‑style issues, and how will the authors fix them? These include missing full‑name expansion for abbreviations at their first appearance in the main text, and inconsistent capitalization of terms that disregards standard academic conventions.
-
SGP4 is merely a simplified analytical physical propagator. Many real-world effects, including time-varying perturbations, maneuvers, drag, and unanticipated orbital changes, cannot be precisely modeled by SGP4. Does generating orbits using SGP4 oversimplify the problem? Is this analogous to stock trajectories: phenomena that are inherently hard to predict yet simplified for forecasting?
-
The LDA assumes linear phase discrepancy within the fitting window. How robust is this linear assumption for debris with rapidly changing drag? Could non-linear phase bias degrade LDA performance significantly?
6 comments
Q4: Robustness of the linear phase-discrepancy assumption under rapidly varying drag.
Thank you for highlighting this assumption. LDA uses a phase-drift rate estimated from historical states to locally calibrate the reference trajectory. Our experiments show that this simple correction is effective on the original validation set and can retain substantial benefits even when the phase discrepancy contains a nonlinear component.
On the original 200-object, 1,000-window validation set, linear LDA achieves a mean position error of 2.562 km, compared with 4.334 km for fixed quadratic extrapolation. The quadratic variant increases the error by 1.772 km, with an object-paired bootstrap 95% CI of [0.285, 4.424] km. This result supports the low-order calibration used in our framework. Building on the linear reference, DynaBR further reduces the mean error to 1.759 km, a 31.3% reduction.
We agree that rapidly varying drag can challenge linear phase extrapolation. When the observed history contains phase curvature that persists into the forecast interval, higher-order extrapolation or a learned residual correction may improve predictions. However, if drag changes after the last observation in ways that cannot be inferred from the available history, history-only methods share an information constraint, although their errors may differ. Additional observations can support forecast updates, while external density forecasts or information about the object’s drag response may improve prediction. Our current results do not establish robustness to rapidly varying physical drag.
To examine sensitivity to phase curvature directly, we prescribed
where c denotes the ratio of the quadratic to linear contribution at 48 h. We retained the original LDA procedure: 2,048 historical samples, a 1,280-point fitting window, one-minute sampling, and a 48 h forecast. The same phase law applies throughout history and forecast, and fitting uses historical samples only.
| Quadratic-to-linear ratio | Uncorrected phase MAE (mrad) | LDA phase MAE (mrad) | Error reduction |
|---|---|---|---|
| 0 | 0.500 | ≈0 | 100.0% |
| 0.25 | 0.584 | 0.139 | 76.2% |
| 0.5 | 0.667 | 0.278 | 58.3% |
| 1 | 0.834 | 0.556 | 33.4% |
| 2 | 1.167 | 1.111 | 4.8% |
LDA reduces the mean phase error by 76.2% and 58.3% at and , respectively. Even when the quadratic contribution equals the linear contribution at 48 h (), it retains a 33.4% reduction.
Follow-up on Our Rebuttal to Reviewer
Dear Reviewer i1Vw,
I hope this message finds you well. As the discussion period is nearing its end with less than one day remaining, I wanted to ensure we have addressed all your concerns satisfactorily. If there are any additional points or feedback you'd like us to consider, please let us know. Your insights are invaluable to us, and we're eager to address any remaining issues to improve our work.
Thank you for your time and effort in reviewing our paper.
Thank you for your comments and we have conducted additional experiments. Our responses are provided below.
Q1: Why is the role of SGP4 under-emphasized in the main text?
Thank you for noting this. Because TLE data are conventionally processed with the Simplified Perturbations models (SGP4), we treated the propagation step as background knowledge and did not highlight it sufficiently. This was an oversight, we will make the data-generation pipeline explicit in the revised manuscript. The full dataset will be released upon acceptance.
Q2: Missing abbreviation expansions and inconsistent capitalization.
We apologize for these writing-style issues. In the revision we will expand LEO, TLE, SGP4, TEME, RTN and LDA at first use and enforce consistent capitalization of module names throughout.
Q3: Does generating trajectories with SGP4 oversimplify the problem?
We appreciate this important concern. SGP4 is a medium-fidelity analytical propagator that accounts for the dominant LEO perturbations (non-spherical gravity, atmospheric drag, third-body effects, and resonance terms) while omitting solar radiation pressure, tides, and higher-order gravity. For the majority of LEO objects, the neglected terms are small relative to drag on the time scales we consider; published SGP4 residual errors are typically on the order of 1 km.
Publicly available continuous trajectories for non-cooperative objects are almost exclusively obtained by propagating sparse observations (TLE or VCM) with a similar dynamical model. High-precision GNSS-derived ephemerides are generally available only for cooperative assets. Consequently, the SGP4-derived dataset remains the most practical large-scale public alternative for the non-cooperative setting we target.
To further mitigate the simulation-to-reality concern, we additionally validated against independent Sentinel POD products. These Precise Orbit Determination solutions are derived from on-board GNSS observations and achieve typical 3D RMS accuracies of a few centimeters (POEORB products typically ~0.6 cm), providing a high-accuracy external reference. The mean position errors of the SGP4 on these POD trajectories are shown below: