- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces UWF, a framework that selectively uses predicted visual and tactile information to improve action generation. It estimates the usefulness of different sensor predictions through their contribution to matching demonstrated actions, then converts the selected information into action corrections. Experiments in simulation and on real robots demonstrate improved manipulation success over the compared baselines.
Critical strengths
-
The paper identifies a meaningful distinction between predicting future observations accurately and predicting information that is useful for control. This is particularly relevant to contact rich manipulation.
-
The method derives its utility supervision from existing demonstrations without requiring additional reward annotations or simulator rollouts.
Critical weaknesses
-
My biggest concern is that the utility measure rewards corrections that reduce action denoising error relative to demonstrations, but this does not necessarily establish their usefulness for completing the task. Different actions may achieve the same goal, and recovering from an unexpected contact may require behavior that differs from the demonstrated motion.
-
Then, the gate’s ability to recognize unreliable corrections is not sufficiently established. If i understand correctly, they are learned from demonstrations, so an unfamiliar contact situation could make both the predicted sensory information and the acceptance decision inaccurate.
Questions for authors
In the real robot protocol, why are visual and tactile keyframes collected every three action slots but incorporated into the history only after the complete chunk, and what mechanism handles unexpected contact changes during that interval?
Given that zero predicted visual and tactile change forces a zero correction, how does UWF handle cases where the absence of an expected change is itself a reason to revise the action?
Can author clarify why using one correction scale for the entire action chunk, given that an unfavorable estimate in any temporal block rejects the whole correction?
3 comments
Response to Reviewer PEGm (Part 2/2)
Q1: keyframes every 3 slots, but history committed only after the full chunk
Conclusion: this is the deployed execution protocol, which UWF inherits from N0-TWAM. Nothing revises the action within a chunk. This is a limitation of the protocol, and the gate does not compensate for it.
What the protocol does:
- Observations. Real visual and tactile observations are captured every 3 action slots, i.e. 4 keyframes per 12-slot frame.
- Commitment. When a chunk completes, its observed keyframes are committed to the model's history. An aborted chunk commits nothing.
- Chunk length. After the cold-start chunk, each chunk executes 24 slots.
What it does not do:
- Inside a chunk, the captured observations do not yet condition the actions being executed. They condition the next chunk.
So an unexpected contact change mid-chunk is reflected only from the next chunk on. Within the current chunk the only safeguard is abort. We do not claim any mechanism beyond this.
Revision: the appendix on deployment will state the commit rule and this limitation explicitly.
Q2: zero predicted change forces zero correction. What if the absence of an expected change should revise the action?
Conclusion: you are right. UWF cannot act on the absence of an expected change. This is a genuine architectural limit.
The residual decoder is zero-initialised and has no bias, so zero predicted evidence yields exactly zero residual. We confirmed this numerically: the empty-evidence residual has a maximum absolute value of exactly 0.0.
Acting on a missing change, for example "contact should have occurred by now", would need a conditioning signal on the discrepancy between expected and observed sensory change. That is a different design from conditioning on the predicted change itself.
Revision: this case will be stated as a limitation, with the discrepancy signal named as the required extension.
Q3: why one correction scale for the whole chunk, when one unfavourable block rejects everything?
Conclusion: the shared scale is a conservative design choice. A single unfavourable temporal block does cap the whole chunk, as you describe. We measured the cost: it is real but small.
The deployed rule is
λ = clip[0,1]( min( aggregate term, min_b q_b / E_b ) ).
Here q_b is the predicted lower-bound benefit of block b and E_b is its residual energy, with 4 blocks per chunk. The second term is a worst-block constraint.
Exact recomputation (rebuttal). We used the recorded residuals for all 256 evidence subsets at three training windows. The gate identity err(λ) − err(0) = λ²E − λB holds to 2.3e-18, so these are exact recomputations.
- In every window only 1–2 of the 4 blocks have a positive benefit.
- A per-block scale beats the shared scale in every window, by 0.0008%, 0.016% and 0.12% of the action loss.
Retrained per-block gate (rebuttal). We retrained UWF with one scale per block.
- Closed loop: 88/100, against 90/100 with the shared scale (p = 0.82).
- Over 3 training seeds: action loss +1.76% (p = 0.54).
The per-block rule recovers what the shared rule rejects, but at this training length that amount is too small to change task success.
Revision: the shared-scale restriction and its measured cost will be stated as a limitation in the method section.
Ethics flag
The ethics statement records that no experiments were conducted with humans as research subjects. It also states that the gate is not a safety guarantee and that deployment near people requires independent safeguards. If a specific concern prompted the flag, we would be glad to address it directly.
Thank you to the authors for the detailed rebuttal, which addressed most of my concerns.
However, my one remain concern is the limited scope of evaluation, particularly regarding robustness to unexpected contacts and out-of-distribution scenarios, epseically for real-robot eval. So, although the rebuttal has strengthened the paper, I will maintain my original rating.
Response to Reviewer PEGm (Part 1/2)
Thank you for the thoughtful review. Several of your points are real limitations, and we say so directly. Where we have new evidence, it comes from 27 models retrained under matched conditions, 9 of them also evaluated in the closed-loop simulator. New results are marked (rebuttal).
W1: reducing denoising error against demonstrations is not the same as task usefulness
Conclusion: we agree that the utility target is a proxy. The external check is closed-loop task success. On the task we tested, removing utility weighting lowers success by 11 points. This supports the proxy there, but it does not show that the proxy and usefulness coincide in general.
The utility target rewards evidence that reduces the action flow-matching loss against demonstrations. Two consequences you raise are correct:
One clarification on multiple valid actions. The target is the flow-matching velocity, whose minimiser represents the whole demonstrated action distribution rather than a single trajectory. So several demonstrated strategies are not penalised against each other. Strategies that no demonstration contains are, as you note, not covered.
New evidence (rebuttal). We retrained UWF with every evidence group weighted equally, which turns the utility-guided feedback into ordinary attention. All other settings are unchanged. Results on Insert HDMI, closed loop, 100 evaluation episodes:
Over 3 training seeds the uniform model also has a higher action loss on every seed (mean +7.3%). So on this task, training with the demonstration-derived utility improves task success, not only the proxy. This is one task and one evaluated training seed. We present it as evidence that the proxy is useful here, not as proof that it measures task usefulness.
Revision: the limitations section will state that the utility target is a demonstration-relative proxy and cannot credit successful behaviour outside the demonstrations. The uniform-weight ablation will be added as the task-level check.
W2: the gate is learned from demonstrations, so unfamiliar contact can make it unreliable
Conclusion: conceded. The gate is not a safety certificate and gives no guarantee under unfamiliar contact. What it does provide is a structural fallback to the base policy.
In-distribution evidence (rebuttal). We overrode the gate's decision on all three insertion tasks in closed loop.
On these tasks the certified λ is 0 on the training episodes. So the gate is declining the correction rather than choosing among corrections, and declining it is the better decision. This is in-distribution evidence only. It does not show that the gate recognises unreliable corrections under unfamiliar contact, and we do not claim it does.
Revision: the method and limitations sections will describe the gate as a demonstration-calibrated surrogate whose failure mode is falling back to the base policy, not as a safety mechanism.