- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies why nearby intermediate states can produce different outputs under deterministic diffusion sampling. It describes Gaussian denoising as competition among clean-data routes and connects posterior covariance to route sensitivity, flow strain, and information gain. It then introduces a finite-horizon Jacobian probe and a Tropical Route Control framework combining event calibration with budgeted verification. Controlled experiments and DiT/SDXL studies support several sensitivity and event-capture observations, but the connection between the tropical route theory and the practical verification pipeline remains only partially established.
Critical strengths
- A useful link between local uncertainty and changes in the final output. The paper explains why a state that is sensitive to small changes now may not produce the largest change in the final image: later sampling steps can amplify or reduce those changes. The analysis makes this distinction clear and states the assumptions and limits of its results.
- Extensive controlled experiments and transparent reporting. The experiments include matched perturbation controls, independent trajectory cohorts, multiple solvers, and an exploratory SDXL transfer study. The finite-horizon direction outperforms a matched random direction on all 64 trajectories in the main DiT test, while risk-based allocation improves event capture under fixed continuation budgets. The appendix also reports negative results and failed validation checks rather than presenting uniformly favorable outcomes.
Critical weaknesses
The practical event is not sufficiently connected to the theoretical route geometry. The deployment target is thresholded CLIP/pixel dispersion, whereas the route-boundary theory concerns specified mixture components or fixed terminal cells. Table 18 reports only approximately 61% agreement between the dispersion and classifier-cell events, and Table 17 does not establish the predicted small-radius scaling regime. These observations do not contradict the conditional theorems, but they leave unclear when tropical route competition, rather than generic within-route variation, explains the measured events in large models.
The main allocation results do not establish the added value of the integrated TRC framework. Appendix D.1 states that deployment uses Gaussian probe directions and a gradient-boosted risk predictor with neither terminal JVPs nor directly measured between-route covariance. Thus, the strongest capture results do not test the proposed finite-horizon direction module. Moreover, Table 18 does not establish superiority of the certified Band-TRC allocator over uniform allocation. The individual components are reasonably motivated, but their combined benefit beyond a generic learned event-priority policy remains un demonstrated.
The practical value of finite-horizon probes under matched total computation is unclear. The main direction experiment evaluates terminal latent gain rather than the deployed decoded-feature event. Table 14 reports approximately 10.38 seconds for exact rank-8 direction construction, versus 0.92 seconds for the instantaneous alternative and 0.41 seconds for one signed continuation pair. Finite differences substantially reduce construction cost, but the experiments do not establish which probing strategy is preferable under an equal total runtime budget.
Questions for authors
Please refer to weaknesses.
6 comments
To further examine whether these sensitivities correspond to meaningful generation changes, we conducted an attribute-level evaluation on native SDXL.
Using 553 GenEval prompts, we evaluated the original output and eight perturbed continuations for each prompt with the official attribute evaluator.
| Attribute-level observation | Prompts |
|---|---|
| At least one output passes and another fails | 91/553 |
| Opposite perturbations along one direction give different decisions | 85/553 |
| Original feature threshold also crossed among attribute-changing prompts | 5/91 |
These results demonstrate that small perturbations of intermediate states can change requested generation attributes in a real pretrained diffusion model. Notably, only five of the 91 attribute-changing prompts also crossed the original CLIP/pixel feature threshold. This further illustrates that feature-space dispersion and task-level semantic changes are different observables.
We also investigated 20 cases with previously observed attribute flips by scanning nine locations along the identified direction and nine locations along a matched orthogonal direction. Across 360 local signed-pair tests, 23 exhibited different attribute decisions.
We then evaluated how well different directional responses rank these local attribute changes:
| Directional response | AUC |
|---|---|
| Denoiser response | 0.683 |
| Terminal CLIP response | 0.501 |
| Terminal latent response | 0.497 |
The denoiser response provides a more informative ranking signal than the two terminal-distance alternatives in this exploratory scan. This offers additional evidence that intermediate-state sensitivity contains information about subsequent task-level output changes.
These results establish an important connection between our theoretical framework and the behavior of real diffusion models. The attribute-level evaluation provides direct evidence of terminal decision boundaries in pretrained SDXL, while the directional scans further reveal how these boundaries are localized in the intermediate state space. This is precisely the type of geometric structure captured by our transported-boundary analysis. Furthermore, the posterior route formulation provides a probabilistic interpretation of the competing clean-data explanations underlying such transitions. Together, these experiments demonstrate that the terminal sensitivity and boundary phenomena studied in our theory have observable and practically meaningful counterparts in large-scale diffusion generation.
Regarding Table 17 and the small-radius scaling law, we agree that the observed finite-radius experiments do not establish the predicted asymptotic exponent of one. The theoretical result is conditional on a regular transported boundary and the limit as the perturbation radius approaches zero. The tested radii in pretrained models are not known to lie within this asymptotic regime.
Importantly, our theoretical analysis also develops non-asymptotic results that directly address finite perturbation radii.
Theorem 5 provides a finite-radius lower bound on the symmetric terminal gain along the leading direction:
Theorem 19 further characterizes the diameter of the entire symmetric endpoint cloud, including endpoint pairs beyond a single signed perturbation:
Both results hold under their respective smoothness, rank, and nondegeneracy assumptions.
Finally, Theorem 6 establishes trajectory-level statistical control for a pre-specified finite-cloud event under exchangeability. Importantly, this guarantee does not require the empirical event prevalence to follow the asymptotic tube-scaling law.
Therefore, the finite-radius deviations do not invalidate the conditional theoretical results or the separate statistical guarantee used by TRC.
2. Concern: What does the integrated TRC framework add beyond a generic learned event-priority policy?
A2. We appreciate this important question. We would first like to clarify that the three TRC components address different aspects of the verification problem:
- Finite-horizon probing determines which perturbation directions are informative about subsequent terminal sensitivity.
- Trajectory-level event calibration provides statistical control for a pre-specified endpoint event.
- Budget allocation determines where limited verification computation should be spent.
These components are complementary, but their empirical contributions should be evaluated separately rather than assuming that their combination automatically yields a superior sampling algorithm.
More broadly, the objective of TRC is orthogonal to the primary objective of conventional diffusion samplers. Existing numerical solvers optimize trajectory integration, while covariance-aware sampling and endpoint-prediction methods exploit posterior or endpoint information to improve sampling efficiency and generation quality. TRC instead asks whether controlled perturbations of intermediate states lead to specified terminal changes, and how limited computation can be allocated to verify such events.
We therefore position TRC as a theory-grounded verification framework and an algorithmic sanity check of the proposed sensitivity mechanism, rather than a replacement for existing state-of-the-art samplers.
To investigate the individual contributions of direction selection and budget allocation, we conducted a factorial comparison crossing three probe directions with two allocation policies on the same 256 DiT-XL/2 trajectories. All probe-construction costs were included in the computational budget.
| Budget | Allocation | Random | Terminal latent | Decoded feature |
|---|---|---|---|---|
| 50% | Uniform | 92 | 92 | 92 |
| 50% | Risk priority | 102 | 108 | 107 |
| 75% | Uniform | 112 | 121 | 120 |
| 75% | Risk priority | 112 | 121 | 120 |
These comparisons help separate the two design choices.
At the 50% budget, changing the allocation policy from uniform to risk priority increases the number of recovered feature events from 92 to 102 for random probes. With risk priority fixed, using terminal-latent or decoded-feature directions further increases the count to 108 and 107, respectively.
At the 75% budget, changing the probe direction under uniform allocation adds eight events for decoded-feature directions and nine for terminal-latent directions relative to random probes. The two allocation policies produce the same counts in this cohort.
We regard these results as evidence that direction selection and computation allocation provide distinct and potentially complementary sources of information. We do not claim a universal additive gain or statistically established synergy between the two modules. We also clarify that the original event-priority allocation results should not be attributed directly to the finite-horizon Jacobian probe: the factorial experiment is intended to examine the contribution of direction selection separately.
The certified Band-TRC allocator serves a different purpose from empirical risk-priority scheduling.
| Cohort | Full-cloud positives | Band-TRC | Uniform |
|---|---|---|---|
| Prospective | 117 | 102 | 100 |
| Independent replication | 135 | 120 | 119 |
The observed capture differences are modest: two additional positives in the prospective cohort and one in the independent replication. We therefore do not claim empirical superiority of Band-TRC over uniform allocation. Its primary contribution is the statistical guarantee under the stated assumptions, rather than maximizing the raw number of captured events.
We believe this framework has several potential applications beyond event capture itself.
First, reliability-oriented generation and verification: in scientific visualization, reconstruction, or autonomous-driving simulation, users may require particular output attributes to remain stable under small perturbations of intermediate states. TRC could identify trajectories requiring additional verification, conservative continuation, resampling, or human review.
Second, solver robustness benchmarking: conventional generation metrics primarily assess average output quality, whereas TRC provides a complementary way to evaluate the sensitivity of trajectories to controlled perturbations under a specified terminal criterion.
Third, failure analysis and mechanistic understanding: the framework can help identify when a specified terminal decision becomes sensitive along a sampling trajectory and whether subsequent dynamics amplify or suppress this sensitivity.
Under the exchangeability and calibration assumptions of Theorem 6, TRC provides event-specific trajectory-level false-acceptance control. This is a theoretical advantage for selective verification, although it should not be interpreted as a universal guarantee of semantic correctness or generation safety.
The current experiments provide an initial demonstration of this direction. Developing stronger algorithms that jointly account for route-sensitive probing, task-level correctness, and the expected benefit of additional computation is a promising direction for future research.
We sincerely thank the reviewer for the careful and insightful assessment. We particularly appreciate the recognition of the distinction between instantaneous sensitivity and finite-horizon terminal sensitivity, as well as the rigor of our controlled sanity check.
We would like to clarify the central contribution and intended scope of our work. Tropical Diffusion Dynamics is primarily a theory-driven contribution. To our knowledge, it provides the first unified theoretical framework connecting competition among plausible clean-data routes, the resulting tropical boundary geometry, the role of between-route posterior covariance in reverse-flow strain and information acquisition, and the propagation of local sensitivity through deterministic diffusion dynamics to terminal outputs.
Building on these theoretical findings, we introduce Tropical Route Control (TRC) as an initial operational framework for finite-horizon probing, statistically controlled endpoint verification, and budgeted computation allocation. Our intention is not to present TRC as a replacement for existing state-of-the-art sampling algorithms, but to demonstrate how the proposed theory can provide a principled foundation for analyzing and verifying terminal sensitivity. We agree that the connection between the theoretical framework and its practical operationalization deserves further clarification. We have conducted additional targeted experiments and elaborate on these connections below.
1. Concern: When does the measured event reflect tropical route competition rather than generic within-route variation?
A1. We appreciate the reviewer for identifying this important distinction. We agree that three mathematically different objects should be distinguished:
These objects are related by our theoretical framework, but they are not interchangeable.
Regarding Table 18, we agree that feature-space dispersion and classifier-defined decision changes do not generally coincide. In two independent cohorts, the exact partitions agree in 58.0% and 58.5% of cases, while their split/no-split decisions agree in 61.6% and 60.9%, respectively.
We believe this discrepancy is informative and consistent with an important distinction established by our theory.
Theorem 2 gives the exact posterior covariance decomposition:
Σq=Σqwithin+Σqbetween.
The within-route component describes posterior variation inside individual routes, whereas the between-route component captures competition between route-conditioned posterior means. In particular, the between-route component determines the spatial Fisher information of the specified route responsibilities through
Σqbetween=q2IR.
Consequently, an output-dispersion event may arise from either within-route variation or between-route competition. A feature-distance threshold alone cannot distinguish these mechanisms.
Theorem 26 further characterizes this distinction geometrically through its bulk–wall decomposition: within-route responses contribute to the absolutely continuous bulk, whereas between-route susceptibility concentrates on regular interfaces of the route skeleton, under the stated projection regularity and exceptional-set assumptions.
Thus, the incomplete agreement in Table 18 does not contradict our theoretical results. Rather, it illustrates why output dispersion should not automatically be interpreted as a semantic route transition, and why distinguishing within-route variation from between-route susceptibility is important when connecting the theory to real models.