- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper asks whether sparsely sampled trajectories contain sufficient information to identify phase variation, independent of alignment-algorithm capacity. The authors derive a Fisher information expression for a scalar warping parameter under baseline-normalized observations. Three observations follow: (i) rigid shifts on constant-derivative segments carry no timing information after baseline subtraction; (ii) endpoint-constrained warping families cannot exactly represent nonzero rigid shifts; (iii) unknown amplitude confounds phase, with an inflation factor set by the amplitude–phase score correlation. Validation uses six warping families, three encoders, prostate DCE-MRI examinations, MAMA-MIA breast MRI, and PhysioNet 2012.
Critical strengths
An estimator-independent perspective on the limits of neural trajectory alignment. The paper shifts focus from expressive alignment algorithms to whether observations support phase estimation at all, and separates model-family restrictions from information limitations; the amplitude–timing confounding analysis is practically informative. This yields useful diagnostics for interpreting learned warps and distinguishing architectural failures from intrinsic observational limits, relevant to functional data analysis, irregular time-series modeling, and neural alignment.
Critical weaknesses
(a) The theoretical guarantee relies on an idealized observation model, and the claimed estimator-independent limitation is broader than what is established. The bound assumes a scalar warping parameter, specified response shape, and Gaussian noise; as a Cramér–Rao bound it requires regularity conditions and applies to unbiased estimators. Yet the motivation concerns joint estimation of shape, amplitude, and warping. Two aspects are concerning: (i) the independent-noise model does not represent the covariance induced by subtracting an observed noisy baseline; (ii) the information quantity depends on response derivative, SNR, and parameter value, so it is not intrinsically computable from measurement times alone. It also does not characterize biased neural estimators or nonparametric warping identifiability. The abstract and conclusions sometimes communicate stronger universality than the mathematics establishes. This gap substantially limits the central claim.
(b) The real-data validation does not fully establish predictive usefulness for acquisition design. Reference values are dense-acquisition estimates, not independently observed ground truth, so reported errors measure agreement with a denser model-based estimate. Much of the strong correlation occurs across schedules with different sample counts, which the paper acknowledges rank equally well alone. The fixed-sample experiment exposes design-time fragility: Appendix I reports a predicted bound of approximately 0.90 s for the earliest-six-frame schedule but a median absolute arrival discrepancy of 54.40 s, because the calculation assumes the response begins at the first sample. Misspecification can also reverse design rankings. More convincing prospective validation is needed.
Questions for authors
(a) Noise covariance after baseline normalization. Equation (4) assumes independent noise after normalization, but subtracting the first noisy measurement induces correlations. What is the precise observation model under which Equation (4) holds? Can the authors derive the covariance-adjusted Fisher information for a noisy baseline and check whether the principal theoretical and empirical conclusions survive? An explicit treatment would substantially strengthen the contribution.
(b) Practical informativeness under uncertain response shape and arrival time. The bound depends on the assumed shape and the response location within the acquisition window, and misspecification can alter its relationship with actual error. How reliably can it rank schedules when shape and arrival time are unknown? Can rankings be evaluated under uncertainty sets or distributions over shapes and arrival times, rather than a single template at ?
(c) Validation against independently established timing information. Can the authors provide evidence that dense-acquisition references are sufficiently accurate, e.g., via independent timing information or an assessment of reference bias under heterogeneous response shapes? Agreement with a dense fitted reference does not by itself establish recovery of the physiological timing parameter.
3 comments
Response to Reviewer 1x5p (2/2): Rankings Hold Under Uncertain Arrivals and Shapes and Against a Model-Free Reference
(b) / Q(b). "How reliably can it rank schedules when shape and arrival time are unknown? Can rankings be evaluated under uncertainty sets or distributions over shapes and arrival times, rather than a single template...?"
Thank you for this suggestion, which we followed directly.
- Averaged over the cohort's distribution of arrivals, the amplitude-profiled bound orders the thirteen placements at 0.89 and 0.92, against 0.687 and 0.676 at θ = 0. Over a wider set of response shapes it is 0.86 and 0.91 (App. F).
- At a single arrival the ordering depends on how exams are summarised; averaged over the prior it does not. At a single arrival it ranges from 0.53 to 0.86 between summaries; averaged over the prior it is 0.87–0.92 under either, and all twelve combinations are in the code release. Averaging the information is the summary the van Trees bound requires, and the one our prospective test pre-registered.
- Under shape misspecification the spread ordering holds at 0.71 while the total-error ranking inverts (§5.6).
- For choosing schedules an arrival-window heuristic did better. In the prospective test, a schedule chosen this way did not beat it (our reply to Reviewer 5HPY, Q2), and the design claim is narrowed to match.
(c) / Q(c). "Can the authors provide evidence that dense-acquisition references are sufficiently accurate, e.g., via independent timing information or an assessment of reference bias under heterogeneous response shapes?"
- Scored against a model-free arrival, the ordering holds at Spearman 1.000 and 0.821 on the two protocols. The model-free arrival is the time to 20% of peak on the dense curve and shares no response model with the bound (App. F). We concede that it is an independent reading of the same dense data rather than the physiological arrival, which no dataset here records.
In the revised PDF (changes in blue): §5.2 and App. F (bound averaged over arrivals and shapes, model-free reference).
Thank you again for the precise questions, which mapped directly onto the changes we made. We hope this answers your questions, and we look forward to your feedback. If it resolves your concerns, we would be grateful if you would consider raising your score.
I appreciate the authors' efforts on addressing my concerns. However, the current version is still quite difficult to follow, and the novelty is not clear. I maintain my original score.
Response to Reviewer 1x5p (1/2): Thank You; the Covariance-Adjusted Bound Is Derived and the Principal Conclusions Survive
Thank you for a thoughtful review! We also appreciate your describing the work as "an estimator-independent perspective on the limits of neural trajectory alignment" and the amplitude–timing analysis as "practically informative."
In short: we derived the covariance-adjusted information you asked for, and the principal conclusions survive; we evaluated rankings under distributions over arrivals and shapes, as you suggested; and we scored the estimates against a model-free reference.
In the revised PDF (changes in blue): §3.1–3.2, App. H (centring, division, regularity, further nuisance parameters) and App. K (AR(1)), with every result recomputed; the abstract, contributions and §6 (rescoped claims).