acceptodds
Under review as a conference paper at ICLR 2027

FIDE: Fiber-Informed Differentiable Experimental Design for Reference-Relative Law Dynamics

Abstract

Aggregate measurements generally leave an evolving population law underdetermined, so different measurement systems can be equally adequate for a scientific task while constraining different aspects of the law. We study how to resolve this residual design freedom in baseline-preserving settings, where an existing dynamical model remains the working baseline outside quantities explicitly valued by the task. iber-nformed ifferentiable xperimental Design () completes each candidate's aggregate constraints by information projection relative to a common frozen reference, then ranks scientifically adequate designs by the dynamical revision required to realize the resulting completed paths. The resulting Full action is the minimum mean-squared velocity correction needed to realize a completed path; equivalently, its square root is the sharp reference-relative expectation-rate discrepancy over a gradient-normalized Sobolev class. This defines a conditional minimum-revision principle for baseline-preserving design rather than a generic truth-recovery objective. Experiments show that this preference changes sensor selection, can help or harm withheld downstream predictions depending on baseline reliability, can be used prospectively from aggregate predictions, and remains computationally usable for a -dimensional configuration law.

Primary area:
learning on time series and dynamical systems
Keywords:
Experimental design, probability-law dynamics, optimal transport, Sobolev discrepancy, reference-relative reconstruction

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_5VDrOpenReview ↗
Rating
2
Confidence
3
Informativeness
1
Presentation
2
Soundness
3
Read review
Paper summary

This paper introduces FIDE (Fiber-Informed Differentiable Experimental Design), which is a framework to evaluate and rank multiple designs that are previously chosen to meet a prescribed scientific accuracy requirement. For each candidate design, the method uses a minimum relative entropy (I-projection) update to complete the design-induced partial information into a full probability law relative to a trusted reference law. The resulting law path is then evaluated using the proposed Full Action objective.

I understand such problems broadly from my work in Uncertainty Quantification (UQ). In particular, I am intimately familiar with I-projections and the work by Csiszar (cited by the authors).

FIDE evaluates a time-dependent law by computing the minimum additional probability-transport velocity needed to realize that law relative to the reference dynamics. The selected design is thus the scientifically adequate design that requires the least dynamical revision of the baseline model. The individual tools are largely familiar to the UQ community (e.g., I-projections and optimal transport). The primary novelty is the synthesis into a baseline-preserving secondary criterion for experimental design.

The paper develops several mathematical characterizations of the proposed objective (variational, transport, and dual formulations) and derives decomposition and differentiability results. Numerical experiments on multiple sensor-design problems illustrate how the proposed baseline-preserving criterion behaves in practice and how its rankings differ from those obtained using more conventual design objectives.

Critical strengths
  1. The mathematical development is thorough and technically sophisticated. The extensive appendices appear to provide a complete mathematical framework that is internally consistent and supports the proposed framework.
Critical weaknesses
  1. While the mathematical development is thorough and appears to be technically sound, the primary conceptual contribution appears relatively modest by comparison. From a UQ perspective, many of the core ingredients are well established. While the novelty appears to lie within how all these ingredients are utilized, and it seems entirely reasonable to do this, I am not convinced that the underlying design principle is sufficiently novel or impactful to justify the breadth of mathematical machinery that was brought to bear on this problem.
Questions for authors

No questions. I believe I understand the proposed framework and its motivation. My concerns primarily focus on the significance and impact of the underlying design principle rather than points requiring clarification.

Reviewer_8MVpOpenReview ↗
Rating
1
Confidence
2
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes Fiber-Informed Differentiable Experimental Design (FIDE), a framework for selecting measurement designs for time-evolving probability distributions when only aggregate observations are available. The central idea is to select, among designs satisfying a prescribed scientific-risk constraint, the one requiring the smallest dynamical deviation from a fixed reference model.

For each candidate design, the method first constructs a probability distribution consistent with the observed moment constraints by minimizing KL divergence from the reference distribution. It then defines the "Full action" as the minimum mean-squared velocity correction required to realize the resulting distributional dynamics. The authors establish its equivalence to a weighted negative-Sobolev norm and derive a Full–Tangent–Hidden decomposition that separates corrections visible through measured moment rates from those associated with unobserved distributional degrees of freedom. They also develop a differentiable optimization procedure for continuous sensor designs.

The framework is evaluated through numerical experiments involving Gaussian mixtures, double-gyre transport, and a 32-dimensional interacting-skyrmion model. The results show that the proposed criterion can select different sensor configurations from conventional alternatives while maintaining comparable scientific risk. Additional experiments examine sensitivity to reference-model misspecification, prediction errors, and numerical approximations. The authors acknowledge that minimizing Full action does not necessarily improve recovery of the true distribution and that its benefits depend on the reliability of the reference model.

Critical strengths
  1. Mathematically well-defined formulation

The paper provides a mathematically well-defined framework for quantifying deviations from reference dynamics through a minimum-energy velocity correction. The connection to weighted Sobolev norms and the Full–Tangent–Hidden decomposition offers a clear interpretation of the proposed criterion. These results provide a solid theoretical foundation for the method, although the underlying mathematical tools are largely established.

  1. Systematic numerical evaluation

The authors conduct extensive numerical experiments across several dynamical systems, including a 32-dimensional interacting-particle model. The comparisons with alternative criteria and the sensitivity analyses demonstrate that the proposed objective can lead to distinct sensor selections and that the numerical results are reasonably stable under the tested conditions. This supports the technical feasibility of the framework, although its practical scientific advantages remain unclear.

Critical weaknesses

The paper presents a mathematically general framework for experimental design, but its scientific motivation relies on a rather restrictive set of assumptions. In particular, the framework requires access to time-dependent aggregate moment trajectories for candidate measurement designs, a reliable reference law and velocity field, and a scientific objective that leaves substantial freedom among admissible designs. Most importantly, it assumes that minimizing dynamical deviations from the reference model is itself a desirable criterion for selecting measurements.

Although the authors explicitly describe this as a baseline-preserving setting, they do not provide a sufficiently compelling scientific application in which these assumptions naturally hold and the proposed secondary objective is demonstrably useful.

The experiments establish that minimizing Full action can produce different sensor selections and reduce the proposed action, but they provide limited evidence that this leads to improvements in scientifically meaningful outcomes beyond those achievable with simpler alternatives, such as static Wasserstein-based selection.

Consequently, despite the mathematical generality of the formulation, it remains unclear what practically important experimental-design problem the proposed framework is intended to solve and why Full action is the appropriate criterion for that problem.

Questions for authors

Can the authors provide a concrete scientific application in which minimizing the dynamical revision of a frozen reference model is intrinsically desirable, rather than merely being a modeling preference? In particular, why should a sensor design that reveals a previously unknown discrepancy from the reference model be disfavored when it achieves the same primary scientific risk?

Can the authors demonstrate a practically relevant setting in which Full action leads to better downstream scientific outcomes than static KL or Wasserstein-based selection, rather than simply achieving a lower value of its own optimization objective?

The framework assumes that time-dependent aggregate moments and their derivatives can be reliably estimated. What are the required relationships among the sampling rate, effective sample size, temporal correlation time, and characteristic timescale of distributional evolution? How robust is the resulting Full-action-based sensor selection when these conditions are not satisfied?

Reviewer_kyRXOpenReview ↗
Rating
3
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper studies a residual question in experimental design: when several aggregate-measurement designs are comparably adequate for a prespecified scientific task, how should the remaining law-level freedom be resolved? In a baseline-preserving setting, FIDE completes each candidate's moment constraints by information projection relative to a common frozen reference law path. It then scores the completed path by its Full action, defined as the minimum mean-squared velocity correction required for the reference dynamics to realize it, and selects the design with the smallest action among those within a tolerance of the best scientific risk. The paper shows that the square root of the Full action is a sharp expectation-rate discrepancy over a gradient-normalized Sobolev class, derives an orthogonal Full–Tangent–Hidden decomposition and a matched-initial stability bound, and establishes local differentiability of the finite-dimensional objective. Experiments on a Gaussian mixture, a controlled downstream study, a prospective double-gyre transport problem, and a 32-dimensional interacting-particle system show that the criterion changes the selected design, can help or harm withheld predictions depending on baseline reliability, and transfers to held-out data.

Critical strengths
  1. The residual design problem is clearly formulated.
  2. The theory is coherent as the minimum-correction, H−1H^{-1}, and dual expectation-rate characterizations give Full a clear interpretation, and the Full–Tangent–Hidden decomposition identifies what the measured moments leave unresolved.
Critical weaknesses
  1. The practical value of the baseline-preserving criterion remains to be demonstrated. The benefit of minimizing Full is conditional on the reliability of the frozen baseline, as the paper itself shows: in the controlled study, the advantage reverses once the task-unprotected coordinate is sufficiently misspecified, and in the Gaussian benchmark the Full-selected design has the largest truth-relative hidden-law discrepancy (Table 1). In practice, the reliability of the baseline in task-unprotected directions is typically unknown, so it is unclear how a practitioner would decide when to apply FIDE. A diagnostic for assessing baseline reliability before design, or an example in which such an assessment is available, would strengthen the case.
  2. All experiments use synthetic or reduced systems. The benchmarks are a Gaussian mixture, a double-gyre simulation, a reduced stochastic skyrmion model, and an analytical unbalanced example. These are well controlled, but the motivating setting of augmenting an existing modeling or observing system is not represented. An application with real sensor data, or at least a realistic observing-system simulation, would help establish relevance.
Questions for authors
  1. How should a practitioner assess whether the frozen baseline is reliable enough in task-unprotected directions to justify the minimum-revision preference? Could FIDE incorporate uncertainty over the baseline?
  2. Is there a setting in which Full yields a downstream benefit that static W2W_2 or forward KL does not, and can such a comparison be added?

Comments on the paper

4 comments

Thank you for clarifying your assessment. We would like to sharpen the significance of the focused design problem.

Aggregate observations can leave an evolving population law underdetermined even when they suffice for a specified scientific task. Several measurement designs can satisfy the task while inducing reconstructed paths with different dynamical implications. Primary-task adequacy alone does not determine how to resolve this remaining choice.

FIDE supplies a reference-relative criterion for that choice when preserving an existing dynamical mechanism is an explicit objective. Its minimum-correction and dual characterizations explain what the criterion measures, while the Full–Tangent–Hidden decomposition identifies corrections omitted by measured moment rates.

The two downstream examples address complementary comparisons. The forecasting example separates Full from static W₂ and forward KL; Full and Tangent select the same design in that example. The occupancy study provides the comparison between Full and Tangent. Within each study, primary risk is identical across candidates, and the downstream loss is excluded from selection. These results show that the distinctions between the criteria can have scientific consequences within the stated settings.

We recognize that reference preservation is a conditional preference and that its usefulness depends on the reference. Our contribution does not resolve non-identifiability or establish reference correctness: instead it provides a mathematically characterized design principle for operating under those limitations.

We respectfully ask that the contribution’s significance be assessed through this residual design problem and its demonstrated consequences. Its focused scope limits the application claim, but we believe the connection between aggregate measurement design, law completion, and reference-relative dynamics constitutes useful methodological knowledge within the scope of OED.

Thank you for the additional clarification and examples provided to all reviewers.

While these help sharpen the intended contribution, I believe my primary concern remains that the method addresses a specialized baseline-preserving design problem whose usefulness depends on the reliability of the reference dynamics, and I remain unconvinced that the resulting design principle is sufficiently novel or broadly impactful for ICLR.

I will retain my rating of 2.

AuthorsOpenReview ↗

Summary of contribution and additional evidence

Dear Area Chair,

Thank you for overseeing the discussion. We would like to summarize the contribution and additional rebuttal evidence.

  • Precise problem formulation. FIDE addresses a residual experimental-design problem: measurements can satisfy the same scientific requirement while inducing completed law paths with different dynamical implications. When baseline preservation is an explicit objective, FIDE compares these designs through the minimum dynamical correction required under a common completion rule and frozen reference. Reviewer kyRX explicitly recognizes that the residual problem is clearly formulated.
  • Mathematical characterization. Our contribution lies in this formulation and its mathematical characterization. The theory gives the criterion a precise interpretation, establishes when Tangent coincides with Full, and constructs regular cases where Tangent action is zero while Full action is positive. Reviewer 5VDr describes the mathematical development as thorough and technically sophisticated and reports no substantive soundness concerns.
  • Systematic experiments and ablations. The experiments span controlled criterion comparisons, prospective sensor selection, and a 32-dimensional configuration law. Ablations examine completion choices, reference misspecification, predictive inputs, and numerical approximation. Reviewer 8MVp recognizes the theoretical foundation and systematic numerical evaluation.

The complementary downstream comparisons address whether these distinctions have consequences beyond reducing Full itself:

Study and downstream lossFullTangentStatic W2W_2Forward KL
Occupancy RMSE (manuscript)0.00214920.00532960.00214920.0053296
Cycle-averaged forecast MSE (rebuttal)0.0050.0050.01250.0125

Within each study, primary scientific risk is identical across candidates, and the downstream loss is excluded from selection.

  • The forecasting example separates Full from static W2W_2 and forward KL.
  • The occupancy study provides the complementary separation from Tangent. Neither Tangent nor static W2W_2 reproduces Full’s lower-loss choice across both constructions under their respective assumptions.

Scope and planned revisions. These results establish conditional benefits. Baseline assessment, field validation, and reliable estimation from finite observations remain limitations. The additional reconstruction experiments characterize estimation sensitivity and distinguish performance against noisy and clean-path objectives; they do not establish a general sampling guarantee. We will incorporate the rebuttal’s forecasting construction and reconstruction analyses into the revised manuscript.

Open discussion point. Our November 14 follow-up to reviewer 8MVp highlights the complementary occupancy comparison and has not yet received a response. We would welcome the reviewer’s assessment of whether this evidence addresses the specific concern about Full’s advantage over Tangent, while recognizing that the broader concerns about practical applicability remain distinct.

We believe the precise formulation, theoretical characterization, and systematic empirical investigation together constitute a substantive methodological contribution to the field of optimal experimental design. We would appreciate your assessment of their combined significance, including how the complementary downstream evidence bears on the remaining concern about Full’s added value.

Thank you,

Authors

AuthorsOpenReview ↗

Comment to all Reviewers

We thank all reviewers for their careful feedback, which has helped sharpen the contribution statement and clarify the method’s scope and limitations. We will incorporate the additional rebuttal analyses into the revised manuscript and remain available for further questions or clarifications.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.