- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies zero-support transition prediction: given a source state and the source and target conditions, the goal is to predict the target state without examples of the requested transition. The authors propose Mechanism-Preserving Transport (MPT), which uses the proposed condition difference to linearly combine shared vector fields, called generators. Integrating the resulting autonomous ODE defines the transition map. Wherever the required exact flows exist, this construction satisfies zero-change identity, reversal, and same-direction composition. The authors compare neural ODE controls with different structural constraints to examine their predictive benefits across tasks. MPT performs well on PDEBench Burgers and controlled periodic advection. On Shapes3D, however, Autonomous-odd reduces latent MSE by 59.5% relative to MPT, while on Norman Perturb-seq, Zero-NODE remains more accurate than MPT after mean-matching training. The theoretical analysis studies when shared generator directions are identifiable in fixed coordinates. Under the stated observation assumptions, it characterizes the activation patterns that permit identification up to scaling and permutation, as well as the mixtures that remain indistinguishable when identification fails.
Critical strengths
- MPT uses shared vector fields and linear control to enforce reversal and same-direction composition in the exact flow, without requiring an additional consistency loss. On Burgers, its direct prediction MSE is 37.8% lower than that of Zero-NODE.
- In fixed coordinates and under the stated observation assumptions, the theoretical analysis characterizes the activation patterns that identify directions up to scaling and permutation, as well as the mixtures that remain indistinguishable when identification fails.
Critical weaknesses
- The evaluation covers PDEBench Burgers and a generated periodic advection task. Although MPT performs well on their primary direct prediction metrics, these settings do not adequately test generalization when multiple generator directions act together. Its ability to handle multiple varying parameters and their interactions in more systems therefore remains unclear.
- In the Norman Perturb-seq experiment, MPT is compared only with Zero-NODE, while Autonomous-zero and Autonomous-odd are omitted. This makes it difficult to determine which structural properties of MPT contribute to its performance.
Questions for authors
- On Burgers (Table 2), why does NCF+/alpha outperform FE-NODE+/alpha and SharedLowRank in direct prediction, while FE-NODE+ /alpha achieves a similar routed endpoint error?
- Could the authors include Autonomous-zero and Autonomous-odd in the Norman experiment to better distinguish the effects of the individual structural constraints (Table 4)?
- Could the authors evaluate MPT on a broader range of PDE tasks to assess whether its benefits extend beyond Burgers and periodic advection?
6 comments
We sincerely appreciate your time and effort in reviewing our manuscript and offering valuable suggestions. As the author-reviewer discussion phase is drawing to a close, we would like to confirm whether our responses have effectively addressed your concerns. If you require further clarification or have any additional concerns, please do not hesitate to contact us. We are more than willing to continue our communication with you.
Thank you for the additional experiments, which address my partial concerns. However, my remaining concern is when the proposed structural constraints are beneficial. In particular, it is still unclear why different structural constraints lead to different prediction accuracies across tasks, and what properties of the underlying dynamics or data might guide the choice of these constraints for a new task?
Response to Reviewer ZkuD
Thank you for reviewing our paper and helping us distinguish between two different extrapolations: predicting a larger change along one physical parameter, and predicting the result of two parameters changing at the same time. Based on this, we added a two-parameter reaction–diffusion experiment. We also ran the two additional controls you suggested on Norman.
1. Why is NCF more accurate than FE-NODE on direct Burgers predictions, while their path-based predictions are close?
Table 2 compares direct and path-based predictions on the same test queries. The direct prediction MSEs of NCF + α, FE-NODE + α, and SharedLowRank were 1.884, 10.01, and 16.56, respectively. For path-based predictions, they were 1.255, 1.206, and 1.348, in the same order. All six values are in units of 10⁻⁴. The gap is mainly in the direct prediction. For NCF and FE-NODE, we evaluated each predictor with its adapter, so this comparison does not separate the adapter’s contribution from that of the underlying dynamics.
Taking the unseen query 0 → 4 as an example, a direct predictor has to predict the entire change in one call from the source field and the condition metadata. For a path-based prediction, we apply the four learned local maps in order, 0 → 1 → 2 → 3 → 4. The prediction at each step is the input to the next; we do not use the true intermediate fields. On this query, FE-NODE’s mean MSE across the three seeds was 0.002442 for direct prediction and 0.000153 for path-based prediction. Its local maps worked well when applied in sequence. The difficulty was predicting the same change in one call.
2. After adding Autonomous-Zero and Autonomous-Odd to Norman, what can we say about reversal and scaling?
We trained four models with the same condition-mean objective and matched training and validation budgets. We tested them on held-out pairs of gene perturbations. We first averaged the errors over three training seeds within each split, then calculated the mean and sample standard deviation across the five overlapping condition splits. The DE20 condition-mean MSEs were 0.07192 ± 0.02147 for MPT, 0.05870 ± 0.01027 for Zero-NODE, 0.06269 ± 0.01184 for Autonomous-Zero, and 0.06112 ± 0.00955 for Autonomous-Odd.
Each of the three controls had lower error than MPT on four of the five splits. In particular, Odd keeps the inverse relation but relaxes the linear scaling of the control. It was still more accurate than MPT on average. So the original result cannot be explained simply by saying that reversal is harmful for gene response prediction. MPT also had the smallest disagreement between direct and sequential predictions: 0.01275, compared with 0.02431–0.02713 for the three controls. On this dataset, the model whose two predictions agreed most closely was not the one closest to the measured mean gene response.
3. Can MPT predict the interaction between two physical parameters when they change at the same time?
We tested this question using the Gray–Scott reaction–diffusion system. The two parameters were the feed rate and the kill rate. For each initial field, we simulated all nine parameter combinations from exactly the same starting point. Training included only single-parameter changes. We tested all 36 directed two-parameter transitions on 128 held-out initial fields. The task was to predict both concentration fields under the new parameters at the same physical time, t = 40.
With only adjacent single-axis changes in training, the mean endpoint MSE across five seeds on the joint transitions was 0.00516 for MPT, 0.10435 for Odd, and 0.04289 for Auto-Zero. A more direct comparison comes from the same trained MPT. When we predicted the two single-parameter displacements separately from the same source and added them to the source field, the endpoint MSE was 0.04902. When we asked MPT to predict the joint change in one call, it was 0.00516.
We also measured the interaction separately. We subtracted the two true single-parameter displacements from the true joint displacement. What remains is the part that simple addition misses. We made the same calculation using the model’s three predictions. Compared with predicting zero interaction, MPT’s interaction MSE in physical units was 91.1% lower with adjacent single-axis training and 88.1% lower when training also included longer single-axis changes. In both settings, MPT had lower interaction error than the zero-interaction baseline on each of the 36 test edges in every seed. The full results are in Appendix D. In this system, MPT learned from single-parameter changes alone and still predicted much of the joint response that simple addition missed.