- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper examines whether flow-matching VLA policies contract perturbations in their initial sampling noise. It measures the largest singular value of a composed sampler Jacobian across four policies and reports both contractive and expansive behavior. It also distinguishes sensitivity to sampling noise from sensitivity to observations and compares end-to-end contraction regularization with a per-step alternative.
Critical strengths
The distinction between noise-to-action sensitivity and observation-to-action sensitivity is useful. It helps clarify what a contraction measurement can establish about a deployed policy. The four-policy study includes finite-difference checks, sampler analyses, and supplementary measurements. These empirical observations could be valuable independently of the stronger theoretical claims.
Critical weaknesses
The interpretation of Proposition 3 and Appendix A conflates continuous-time contraction with contraction of a discrete Euler step. In the stated counterexample, both Euler factors already have operator norm approximately 1.526, while their product has norm approximately 2.329. Thus, the example demonstrates that discretization can break contraction; it does not demonstrate that genuinely contractive steps compose into an expansive map. Appendix F also applies a raw symmetric-Jacobian penalty to policies with negative sampling time steps, without clearly accounting for the integration direction. These issues undermine the central comparison against per-step contraction analysis.
The claimed exactness and validation of the measurement need reconciliation. Section 3.1 describes an exact deployed-sampler Jacobian, whereas Appendix D states that the reported object is a product of active-block restrictions. These generally differ when perturbations can propagate through padded dimensions. The supplementary full-Jacobian checks are helpful but do not establish equivalence throughout the evaluation. In addition, Section 4 says all models pass the validation protocol, while Table 3 marks nonlinear-predictiveness evidence as unavailable under the common protocol for two models.
Questions for authors
Do you agree that the Appendix A example establishes a discretization failure rather than failure of continuous-time contraction? Which central conclusions remain under this interpretation? How is the Arm C penalty derived for policies using negative time steps? Is the velocity Jacobian reoriented before applying the penalty? Are padded dimensions clamped at every step of the deployed sampler? If not, how does the product of active-block Jacobians account for paths through those dimensions?
4 comments
Response to Reviewer zMjU (2 of 3)
Response to Reviewer zMjU (2 of 3).
This comment answers Q3 and Q4 on the Arm C penalty of Appendix F.
Q3 and Q4, how was the Arm C penalty derived, and was the Jacobian reoriented? In the submission it was not. Arm C penalised Σ_k relu(λ_max(sym J_k)) on the velocity Jacobian at the sampler's knots. This is the CDP-class object as written for forward integration, while SmolVLA and π0 integrate with dt = −1/K. For a backward step I − |dt| J_k the per-step log-norm is λ_max(sym(−J_k)) = −λ_min(sym J_k). The submitted penalty therefore constrained the wrong end of the spectrum, as the reviewer inferred. We re-derived it with the orientation explicit as relu(λ_max(sym(sign(dt) J_k))). We then re-ran Arm C on the identical recipe (same training entries, steps, seed, penalty observations and held-out flows).
Re-oriented, the one-sided penalty contracts as well, and the paper's conclusion about the cost of contraction is unchanged.
| Arm (σ_max median on 10 held-out flows) | SmolVLA, steps 50 / 100 / 150 | π0, steps 50 / 100 |
|---|---|---|
| Baseline | 1.867 | 3.041 |
| A, FM only | 1.405 / 6.058 / 1.428 | 1.251 / 3.029 |
| B, two-sided end-to-end | 0.713 / 0.850 / 0.973 | 1.013 / 0.992 |
| C, one-sided as submitted | 0.973 / 0.906 / 1.056 | 1.611 / 2.752 |
| C, one-sided re-oriented | 0.931 / 0.763 / 0.750 | 1.010 / 1.018 |
On SmolVLA the re-oriented Arm C contracts at every checkpoint on 10/10 held-out flows, and it ends deeper than Arm B. On π0 it reaches the boundary (2/10 flows below 1), level with Arm B at 0.99 to 1.01. Training drove its oriented per-step log-norm to the penalty threshold of zero and stopped there. A per-step bound at zero leaves the O(dt²) Euler term of the step uncontrolled, which is the same discretisation point as Q1.
The sentence "only the two-sided object contracts; the one-sided object fails on both architectures" (Sec. 5.4, App. F) is therefore replaced. Appendix F now compares an end-to-end penalty with a correctly oriented per-step penalty, and both induce contraction. The conclusion that carries Sec. 5.4 is untouched and now rests on both arms. Every arm that contracts fails the pre-registered non-degeneracy gates, B and re-oriented C alike. Observation coupling falls to 0.09 to 0.17 of baseline. Contraction can be engineered, but not without this cost, and the tradeoff null stands (C5).
Response to Reviewer zMjU (3 of 3)
Response to Reviewer zMjU (3 of 3).
This comment answers W2, Q5 and Q6 on the exactness of the witness, the padded dimensions and Table 3. It then lists all changes to the paper.
Q5, are padded dimensions clamped at every step? They are not. Every deployed sampler evolves all 32 latent dimensions at each step and slices the 7 active DoF only at the output. The witness varies the active block with padding held fixed. It is therefore the active-block restriction of the full propagator, as Sec. 3.3 and App. D state. Proposition 1 is exact for the full 32-dimensional state; the reported witness is its restriction, and Sec. 3.1 should not call it exact.
Q6, how does the restriction account for paths through padding? It does not account for them by construction. We therefore measured them directly on the paper's panel, with the same seeds and draws. For the contractors we computed the full 32-dimensional deployed Jacobian on every draw. For the expanders we computed the exact Jacobian-vector product of the full sampler along the witness's top direction, which lower-bounds the deployed gain and suffices to decide the sign.
The witness is the restriction of an exact Jacobian, and on every draw of the panel it reads the same sign as the full deployed map.
Table. The full deployed sampler against the active-block witness, on every draw of the paper's panel.
| Model | Verdict | Draws on the witness's side of 1 | Full deployed gain |
|---|---|---|---|
| SmolVLA | expands | 160/160 | at least 1.33 on every draw |
| π0 | expands | 320/320 | at least 2.21 on every draw |
| π0.5 | contracts | 320/320 | within 1.1% of the witness |
| GR00T | contracts | 160/160 | 0.76 to 1.01 of the witness, median 0.92 |
The active columns carry 96.7% to 99.9% of the deployed gain, so paths through padding carry at most 3.3% and never change a verdict. The witness is within 1.1% of the deployed gain for π0.5 and conservative for GR00T. Sec. 3.1 will describe the witness as the active-block restriction of the exact Jacobian, within 1.1% of the deployed gain for π0.5 and conservative for GR00T. The scope paragraph of Sec. 3.3 moves next to it (C1).
Table 3. The two entries marked † are now witnessed on the common footing. The same audit records the full nonlinear deployed gain ρ along the witness direction at ε ∈ {3e-2, 1e-2, 3e-3, 1e-3, 3e-4} on every draw. ρ lands on the witness's side of 1 at all five ε for all 960 draws. At ε = 1e-3 the median deviation of ρ from the witness is 0.08% (SmolVLA), 0.36% (π0), 0.02% (π0.5) and 9.8% (GR00T, the conservative gap above). Its deviation from the exact Jacobian-vector product is 0.01 to 0.02% for all four. Sec. 4 will state gate (iii) at ε ≤ 0.03, the range tested on this footing. Table 3 is completed (C2).
Changes to the paper (revised PDF, within the 10-page limit). C1 Sec. 3.1 exactness wording, scope statements consolidated, deployed-sampler audit in App. D. C2 Table 3 completed, gate (iii) at ε ≤ 0.03. C4 and C5 as stated in comments 1 and 2. C7 presentation, which the reviewer rated lowest. The sign of dt and the orientation of every per-step quantity are stated once in Sec. 3.2 and used consistently. Each quantity is introduced in words before its symbol. Derivations not needed for the main argument move to the appendix. Changes for the other reviewers (premise sources, multimodality probe) are in the general response.
Both concerns have been addressed by measurement rather than by argument, and the central result is stronger than it was at submission. If the reviewer agrees, we would be grateful if this were reflected in the soundness assessment, and we welcome any further question.
Response to Reviewer zMjU (summary)
As the discussion period closes on 18 November, we summarise briefly how the two main concerns raised in the review were addressed by measurement, and where the corresponding changes appear in the revised PDF.
W1. Read in each sampler's own integration direction, the per-step criterion certifies contraction for GR00T (160/160) and π0.5 (292/320), certifies none for the expanders, and is never falsely satisfied. Proposition 3, App. A, Table 1 and Sec. 5.2 are restated in these terms (C4). The re-oriented Arm C penalty also induces contraction, and the conclusion on the cost of contraction is unchanged (App. F, C5).
W2. The witness is the active-block restriction of the exact Jacobian. On all 960 draws it reads the same sign as the full deployed map, with paths through padding carrying at most 3.3% of the gain. Sec. 3.1 now describes it in these terms and the audit is in App. D (C1). Table 3 is completed on the common footing (C2).
We hope this summary is helpful and would be glad to answer any remaining question before the discussion closes.
Response to Reviewer zMjU (1 of 3)
Response to Reviewer zMjU (1 of 3).
We thank the reviewer for a precise and careful review. The reviewer notes that the empirical measurements stand independently of the theoretical framing, and the new measurements below bear this out. We answer in three comments. This one answers Q1 and Q2, on the Appendix A example and on which conclusions remain. The second answers Q3 and Q4, on the Arm C penalty. The third answers W2, Q5 and Q6 on exactness, padded dimensions and Table 3, and lists all changes to the paper.
Q1, does the Appendix A example establish a discretisation failure? We agree that it does. Each Euler factor I + J_k in the example has operator norm 1.526. The example therefore shows that a step with λ_max(sym J_k) < 0 need not be a contraction once discretised at dt = 1. It says nothing about composing contracting maps, since two maps of norm below 1 cannot compose to a norm above 1. Proposition 3 and Appendix A will be restated as a discretisation result (C4).
The discretisation gap is the one that matters for a deployed sampler, and we have now measured it. The deployed policies are Euler samplers with dt = −0.1 or +0.25, while the field's per-step criterion λ_max(sym J_k) ≤ 0 is a continuous-time statement. Whether the continuous criterion controls the discrete step is therefore the question to check rather than assume. With the orientation made explicit (below), the per-step bound B = exp(Σ_k |dt| μ_k) upper-bounds the measured end-to-end gain on 960/960 draws of the paper's panel. On these samplers the Euler term never breaks the certificate.
Q2, which central conclusions remain? All four central conclusions remain. Three are not affected by the review, and the fourth is sharpened by it.
The orientation. For a sampler that integrates with dt < 0 the step is I − |dt| J_k, so the controlling end of the spectrum is λ_min(sym J_k), not λ_max. We re-derived the per-step bound with the sign of dt explicit, so that μ_k = λ_max(sym J_k) for dt > 0 and μ_k = −λ_min(sym J_k) for dt < 0. We then re-evaluated it from the saved per-knot spectra of all 960 draws.
The result. With orientation, the per-step criterion certifies π0.5's contraction on 292 of its 305 contracting draws and never certifies an expanding draw. The disagreement reported in Table 1 and insight (a) came from reading λ_max(sym J_k) on dt < 0 samplers. Once oriented, the one-sided per-step certificate is sufficient and conservative on the deployed samplers (13 contracting π0.5 draws are not certified, none is falsely certified). The end-to-end gain remains the quantity that decides the verdict and the one to report. This is the methodological point the revised paper makes.
In the revision (C4), Table 1, Sec. 5.2, insight (a) and contribution 2 are rewritten in these terms. The gate (ii) self-test is re-described, since its one-sided disagreement is also the orientation effect. The Related Work sentence on a policy where the two verdicts disagree is removed.