- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes ReView, a test-time calibration method for recovering frozen visuomotor policies after camera displacement. It fits a six-parameter image warp by matching mean spatial features from stored nominal-view demonstration images and four unpaired reset images from the displaced camera. The fitted warp corrects subsequent observations without policy updates, depth, measured camera extrinsics, or target action labels. Experiments across three policy families, six simulation tasks, and two real-robot tasks demonstrate substantial recovery over uncorrected inputs. Ablations and geometric analysis examine the importance of spatial information and explain why accurate image alignment does not necessarily yield the best control performance.
Critical strengths
-
The calibration procedure is lightweight and requires little additional data. ReView fits only six warp parameters using stored demonstration images and four unlabeled reset images, without updating the policy or requiring depth, measured camera extrinsics, action labels, or interaction rollouts. This makes it an appealing recovery procedure for an existing policy after a camera is displaced.
-
The experiments demonstrate substantial recovery and provide useful analysis. ReView improves average simulation success by approximately 28, 22, and 24 percentage points for Diffusion Policy, ACT, and SmolVLA, respectively, with additional gains on two real-robot tasks. The ablations show the importance of retaining spatial information, while the parallax analysis explains why accurate tabletop alignment may still leave control-relevant gripper–object relationships distorted.
Critical weaknesses
-
The methodological advance over existing methods is unclear. Correcting observations before a frozen policy is already explored by AnyCamVLA and GS-VLA, and optimizing geometric alignment through feature matching is well established. ReView’s distinction is its use of a few unpaired RGB images without measured geometry. However, simpler alignment methods recover much of the same performance: on robomimic with Diffusion Policy, ReView achieves 59.5% success versus 58.7% for pixel correlation and 58.5% for ECC. These results leave the significance of the proposed formulation insufficiently established.
-
Evaluation on stronger generalist robot policies is needed. The experiments emphasize Diffusion Policy and ACT, with real-robot validation limited to Diffusion Policy. Although SmolVLA is included, it provides a narrow basis for claims of applicability to generalist policies. Moreover, ReView underperforms pixel correlation on SmolVLA in ManiSkill (37.4% versus 43.3%). Evaluation with an additional generalist policy such as π0.5 would make the study more representative and test whether the benefits extend beyond the policy families where the method currently performs best.
-
The spatial-matching assumption remains insufficiently stress-tested. ReView assumes that source and target images retain enough comparable spatial structure for feature mismatch to identify camera displacement. With unpaired scenes, changes in object placement or robot configuration can be mistaken for camera motion; occlusion and parallax further weaken correspondence. The same-state reference and reference-selection experiments provide useful evidence, but do not establish robustness to systematic differences between source and target reset distributions. Averaging only four target images does not necessarily resolve these ambiguities. Separately, the reported 16-percentage-point degradation on Square even without camera displacement demonstrates that calibration can harm an otherwise unchanged deployment.
Questions for authors
-
Clarification: Under what conditions does ReView offer a meaningful advantage over simpler spatial RGB or pixel-correlation alignment? Given their similar performance in several settings, please clarify what benefit is specifically attributable to the proposed feature-based formulation.
-
Additional evaluation request: Does the benefit extend to a stronger generalist policy such as π0.5? This would be particularly informative given that pixel correlation outperforms ReView on SmolVLA in ManiSkill.
-
Clarification and robustness evidence: What similarity between source and target reset distributions is required for reliable calibration? Have you tested systematic changes in object placement or robot configuration while holding camera displacement fixed? Please also explain whether the nominal-camera degradation on Square could be detected from the calibration objective or validity checks without executing the policy.
5 comments
Reset-distribution shift and a rollout-free check for the nominal camera (2/2)
W3 & Q3 (a): "With unpaired scenes, changes in object placement or robot configuration can be mistaken for camera motion … Have you tested systematic changes in object placement or robot configuration while holding camera displacement fixed?"
Yes. We fixed the camera displacements and shifted the reset distribution. Objects and goal moved by 3 cm in x and in y, and the robot's initial joints were offset by about 4 cm at the gripper. We applied the shift at half, full and double strength, to both the calibration resets and the rollouts (ManiSkill, DP):
| Shift | No adapt. | ReView-pix | ReView |
|---|---|---|---|
| None | 36.8 | 57.3 | 65.1 |
| Half | 30.6 | 46.0 | 57.4 |
| Full | 22.6 | 32.3 | 44.4 |
| Double | 8.1 | 9.0 | 17.4 |
- Up to full strength, ReView stays more than 20 points above no adaptation, and it beats pixel matching at every strength.
- At double strength, the policy itself mostly fails even without adaptation, which limits what any input correction can recover.
- In Proposition 1, such a mismatch is the bias term d₀. This is why we calibrate on initial frames, which are not affected by the displaced policy's own actions.
W3 & Q3 (b): "… whether the nominal-camera degradation on Square could be detected from the calibration objective or validity checks without executing the policy."
Yes.
Why Square drops. At the nominal camera, the fitted warp on Square is only 0.26 px, so the drop is not caused by a large wrong correction. Passing the images through the warp sampler with near-identity warps already lowers Square by about 5 points. The closed loop on this task is sensitive to tiny pixel changes.
The check. It uses only the calibration images, and estimates the noise term of Proposition 1.
- We resample the 16 source and 4 reset images 20 times and refit the warp each time.
- If the fitted displacement lies within the 95th percentile of the resampled fits, we keep the identity. The warp is then skipped, and the policy sees the raw frames.
- The check takes 2–3 minutes on one GPU and needs no rollouts.
Results.
- At the nominal camera, the check keeps the identity on all three robomimic tasks and on all nine ManiSkill task–policy combinations. This removes the degradation; for example, DP on PushCube returns to 91%.
- Under real drift, it triggers only in a few cells at the smallest level, L0, where the unadapted policy already does well. The overall cost is 0.2–0.3 points.
We will add this check to Sec. 3.
We hope these answers address the reviewer's concerns, and we would be glad to discuss further.
Kind Request for Feedback on Our Rebuttal
Dear Reviewer 6sbM,
Thank you again for your detailed assessment and helpful suggestions. As the discussion period is drawing to a close, we wanted to kindly follow up on our rebuttal and the revised paper.
Following your comments, we added results on , tests with shifted reset distributions, and a rollout-free check for the nominal camera.
We would be grateful to know whether our responses resolve your concerns. If any remain, we would be happy to provide further clarification or additional results before the deadline.
Best regards, The Authors
Advantage over pixel alignment, and results on π0.5 (1/2)
We thank the reviewer for the detailed assessment, and for finding the method lightweight and the parallax analysis useful. The suggestions to test π0.5 and to examine the Square case led to two useful additions.
Unless stated otherwise: success rate (%), averaged over three tasks and drift levels L0–L3 (0–10 cm / 0–10°).
On robomimic, the two are close, as the reviewer notes. On ManiSkill, feature matching is clearly better whenever the features suit the encoder.
Relation to AnyCamVLA and GS-VLA. Both also correct the input of a frozen policy, but both need the calibrated pose of the displaced camera and a view-synthesis model; GS-VLA also needs metric depth (Table 17). ReView uses four unlabeled RGB images and one fixed warp.
Contribution. We do not regard feature registration itself as the contribution. The contribution is showing that a frozen policy can be recovered from such minimal data, together with the analysis of why image alignment and action recovery can disagree. The analysis is borne out by ReView exceeding the ground-truth table-plane rectification under translation (DP 48.9 vs. 36.3; ACT 48.8 vs. 32.1).
Yes. We fine-tuned π0.5 on both benchmarks and evaluated it with the same cameras, initial states and calibration images: