- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies when fixed-receptive-field score models trained on small spatial systems can extrapolate to larger ones. Its central claim is that architectural locality and local clean interactions are insufficient: the relevant quantity is the spatial response of the Gaussian-smoothed score, which is governed by noisy-posterior covariance. The paper introduces a response-tail diagnostic and proves a system-size-independent bound on fixed-patch distribution error under dynamic quasi-locality and influence-weighted drift-error assumptions, together with regularity and initialization conditions. It also introduces Finite-Depth Local Flow, a synthetic benchmark with exact clean densities and scores and controllable clean-score response structure. Experiments on 2D and 3D FDLF systems examine size transfer and receptive-field dependence; an additional Ising experiment demonstrates increasing missed far-field response near criticality under a controlled perturbation test.
Critical strengths
1. The distinction between architectural locality and smoothed-score locality is important and well motivated. The posterior-covariance identity in Eq. (9), although standard, clarifies why local clean interactions need not imply a local denoising rule. The paper uses this identity and the response tail in Eq. (5) to formulate a concrete diagnostic for local score extrapolation, rather than treating the ability to run a convolutional model on larger inputs as evidence of valid transfer.
2. The white-box FDLF benchmark enables direct and interpretable evaluation of local size extrapolation. FDLF exposes exact clean scores and allows controlled variation of teacher response structure, supporting score-error and near/far-response measurements that are more directly interpretable than sample-quality metrics alone. The experiments include short-range controls, receptive-field sweeps, 2D and 3D evaluations, and multiple training seeds. These features make the benchmark potentially useful for distinguishing stable transfer from response-mismatch failures.
Critical weaknesses
1. The theoretical guarantee does not establish extrapolation from training-size error. Assumption 5 requires a system-size-independent bound on influence-weighted drift error along learned reverse trajectories. The paper does not derive this bound from DSM error at the training size or from the response tail beyond the model's receptive field. The theorem therefore provides a conditional stability guarantee for generated patch distributions, but does not establish that a model trained on a small system satisfies the required error bound on larger systems.
2. The empirical evidence does not fully validate or isolate the proposed mechanism. FDLF compares student score predictions on clean samples at with exact clean scores, rather than evaluating smoothed-score accuracy at typical noisy observations or the accuracy of generated patch distributions. The exact Gaussian reverse-process analysis in Appendix A.3 does not close this gap. The Ising size-transfer test in Figure 4 starts from ; its perturbation lies entirely outside the receptive field, so the CNN's predicted center-score change is identically zero regardless of training. This demonstrates a representational limitation at the tested configurations, but not its prevalence under typical noisy observations or its impact on generation. Finally, the unnormalized long-range FDLF kernel allows total coupling to increase with size, leaving receptive-field limitations insufficiently disentangled from potential shifts in local marginals and field scale.
Questions for authors
1. Theoretical clarification: What additional assumptions would allow in Assumption 5 to be bounded in terms of population excess DSM risk at the training size and the response tail beyond radius ? In particular, what conditions are needed to control cross-size changes in local noisy distributions and the distribution shift from noisy training data to learned reverse trajectories?
2. Evidence connecting the diagnostic to generation: Does the response-tail diagnostic predict score error at typical observations across several non-negligible noise levels, and does this relationship extend to fixed-patch distribution accuracy after learned reverse sampling? In particular, does the Ising size-dependent mismatch persist under typical noisy observations, rather than only in tests starting from ?
3. Controls for interpreting the failure mechanism: Does long-range FDLF degradation persist in an additional control that approximately holds total coupling or field scale fixed across sizes? At each evaluation size, how does the transferred model compare with the same architecture trained directly at that size under comparable optimization conditions?