- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3(+1)
- Soundness
- 2
Read review
Paper summary
The authors diagnose an "action-credit gap": OPD's action-token KL loss is applied before execution and is blind to whether the resulting crop is useful. To address this gap, the authors propose Execution-Conditioned Entropy Drop (Exec-ED), a label-free residual added on top of OPD. Exec-ED measures each executed crop's entropy drop in the frozen teacher's answer distribution relative to a null (unzoomed) view, centers this signal across K=8 sibling crops sampled for the same state, and applies the resulting REINFORCE-style credit only to action tokens (Eq. 3-4). Experiments with Qwen3.5-9B and 4B teachers distilling into a 2B student on ZoomBench-MCQ and V*Bench show that Exec-ED consistently recovers much of the crop precision lost under OPD while maintaining comparable end-to-end accuracy.
Critical strengths
- The reader-actor swap methodology (Table 9) and the finding that OPD's sampled crops degrade while greedy crops improve (Figure 2a) provide a sharp, falsifiable characterization of what OPD transfers. The fact that token-reweighting variants (TA-OPD, VA-OPD) cannot fix the gap (Section 3.3) further sharpens the diagnosis.
- Exec-ED adds exactly one design choice on top of a standard REINFORCE estimator, applied only to action tokens. The objective-switching experiment showing that the effect lasts only while applied, the anchor-removal ablation showing that the KL is necessary to prevent collapse, and the temperature sweep showing that the advantage persists at matched temperatures collectively provide strong mechanistic understanding.
Critical weaknesses
- The gap between crop quality and task performance undermines the practical narrative. The paper's central claim is that Exec-ED "recovers much of the crop quality OPD loses," but the relationship between crop quality and downstream accuracy is not established. In Table 3, Exec-ED at lambda=0.2 with the 9B teacher has precision 58.78% (near Base's 59.18%) but accuracy 55.09% -- only 0.1 points above OPD's 54.99% for VA-OPD.
- The experimental scope is narrow for the generality of the claims. The paper frames the action-credit gap as a general property of OPD for agents that "act before answering", yet the entire evaluation uses a single-step crop-and-answer format with one student model family. The concluding sentence -- "execution-aware distillation can learn from both the teacher's behavior and the consequences of the student's own actions" -- suggests broad applicability, but the paper provides no evidence for multi-step agents, non-crop actions.
Questions for authors
- Can you provide evidence that the improved crop quality under Exec-ED translates to a downstream benefit beyond the marginal accuracy differences in Table 3? For instance, does it help in a multi-step visual search setting, or when the reader is weaker and more dependent on crop quality?
- Why is the principled floor from Proposition 2(iii), which guarantees non-positive advantage for malformed actions, not adopted as the default? The current default (u=0) gives malformed actions positive credit in the majority of states with malformed siblings (54%, Section A.3).
4 comments
Follow-up to Reviewer H78b: brief summary of our response
Dear Reviewer H78b,
Thank you again for the detailed review; your points on scope and on the link between crop quality and task performance made the paper's claims considerably more precise. A brief summary of how the revision responds:
- W2 (scope). The claims are now scoped to single-crop agents (the quoted sentence is removed; Limitations are added in §7). A second model line (Qwen3-VL 8B→2B) further sharpens the diagnosis: OPD moves the student's crops in the teacher's direction in all three settings, and Exec-ED corrects most where that direction costs precision (§6.5).
- W1 (crop quality vs. accuracy). While ZoomBench accuracy remains comparable to VA-OPD's, the revision shows where better crops convert into task gains: on V*, a hit is answered correctly in 93.3% of cases against 41.2% for a miss, and accuracy is numerically above OPD's in all three training runs (+1.3 to +4.4 points); on ZoomBench the gain over OPD is +0.7 to +1.8 points, significant in two of three.
- Q1 (multi-step search). This is beyond our experiments, as §7 now states. The single mandatory crop isolates the quality of an action from the decision of whether to act; Exec-ED targets the former and, being one additive credit on the action tokens, should be complementary to methods that learn when to act.
- Q2 (floor). Trained as you suggested: malformed actions fall from 4.25% to 2.52% with slightly higher precision, while greedy accuracy is 2.10 points lower in this single run (App. A.3).
We would greatly appreciate your view on whether, with the claims scoped this way, the revision addresses W1 and W2. If any part remains open, or an analysis on our existing results would be useful, we would be glad to add it; given the approaching deadline, hearing from you early would give us time to do so properly. We sincerely thank you for your time and consideration.
Thank you for the detailed response. The scoped claims, the new analysis linking crop quality to task accuracy, and the additional experiments have addressed all of my concerns. I am glad to raise my score to 3.
Dear Reviewer H78b,
Thank you very much for taking the time to go through our response and the revision, and for updating your assessment. Your comments on scope and on the link between crop quality and task performance directly shaped the revised claims and the new analyses, and we are grateful for them. The scoped claims and Limitations paragraph will be kept in the final version.
Response to Reviewer H78b
Thank you for the detailed review. Notation as in the general response: * = the 95% paired bootstrap interval excludes zero; ZB = ZoomBench-MCQ; differences are Exec-ED (λ=0.1) − OPD with the 9B teacher, within the retrained control suite unless stated. Numbers without a table or section reference are reported here only.
W1 (crop quality vs. task performance). The revision now addresses this relationship (§5.2), and the answer depends on the benchmark. On ZB you are right: the accuracy difference from VA-OPD is small and not significant, and we claim none. On V*, a crop that hits the evidence is answered correctly 52 points more often than one that misses (7 points on ZB), and accuracy is numerically higher than OPD's in all three training runs (significant in one; Table 20). On ZB the gain over OPD is smaller (+0.7 to +1.8 points, significant in two of three runs), and more hits explain little of it. These are associations, not causal estimates; details are in G2 of the general response.
W2 (scope vs. generality of the claims). We agree that the framing was too broad. The sentence you quote is removed; abstract, introduction and conclusion now speak of single-crop agents and of our main setting; a Limitations paragraph is added. We also ran a second model line from the same vendor (Qwen3-VL 8B → 2B). There the teacher crops more precisely than the student, OPD alone transfers that precision, and Exec-ED adds little (at λ=0.1 nothing changes significantly; at λ=0.2, V* hit rises by +3.12* and ZB accuracy falls by 2.29*). The diagnosis is therefore stated as teacher-dependent: the student's sampled crops move in the teacher's direction, for better or worse (G3, new §6.5).
Q1, multi-step visual search. We did not test this, and we do not know whether the gain carries over. Our setting, shared by every method we compare, fixes exactly one mandatory crop. This removes two things a multi-step agent must learn: whether and when to act, and how to credit an early action for what later steps reveal. Exec-ED as implemented here credits an action only by the view it returns immediately, so it addresses neither. We therefore limit the claim to single-crop acquisition and state multi-step and optional tool use as outside the scope of our evidence (§7).
Q1, weaker readers. The gain holds for the trained readers we tested, including a held-out one, but not for the weakest. Under the two trained student readers and the held-out 27B reader, Exec-ED's crops are more useful than OPD's (+0.84*, +0.86*; G +0.98*). With the Base student (before distillation) as the reader they are not (−0.08, n.s.; §6.1, Table 23). So we have no evidence that weaker readers benefit more, and we make no such claim.
Q2, the floor of Prop. 2(iii). You are right that the floor removes this case by construction, and the revision now reports what happens when it is used (§5.1, App. A.3). In a single run trained with the floor, Exec-ED leaves fewer malformed actions (2.52% against 4.25%, −1.73*) and has slightly higher precision (+1.06*), but its greedy accuracy is 2.10* points lower; sampled accuracy, IoU and G do not differ significantly. We keep u=0, the setting of all other runs; the floor is a viable alternative with this trade-off.
Three further numbers on the default:
One caveat: in the 12× credit control (λ=1.21), 16 of 606 greedy actions are malformed, against 2 at λ=0.1 (App. H), so the floor may matter more at higher credit strength; its sampled malformed rate (2.97%) is still below OPD's (4.58%; Table 21).
In sum. The revision accepts both of your main points: on ZB the accuracy difference from VA-OPD is small and not significant, and the claims are now limited to single-crop agents in our main setting. What stands: in that setting OPD improves the reader far more than the actor and makes the sampled crops less precise; a label-free credit on the action tokens recovers much of that precision at comparable accuracy, in three training runs; and on V*, where a hit goes with a correct answer most strongly, accuracy is numerically higher than OPD's in each. The paper also states where the method adds little (a teacher that already crops more precisely) and what it does not address (multi-step and optional tool use).