- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Action-Space Velocity Correction (ASVC), an inference-time method that corrects Flow Matching velocity fields without retraining the original robot policy, aiming to mitigate policy performance degradation caused by visual variations in lighting, color, and background. The proposed method leverages an additionally trained reference mapping to generate observations close to the training visual distribution and selectively corrects the velocity during flow integration based on the residual projection between the original and reference velocities. The authors validate the approach on Toy Reaching, three types of base policies on DMC-GB2, and a real-world robot block-stacking task. Experimental results demonstrate that ASVC substantially recovers part of the task performance lost under visual shifts while largely preserving performance in the original environments across most settings.
Critical strengths
-
Targeting the performance degradation caused by visual environmental changes during robot policy deployment, this paper proposes an inference-time velocity correction method without retraining the original policy. This approach reduces the cost of adapting deployed policies to new visual environments and provides a meaningful research direction for improving the visual generalization capability of robot policies.
-
The proposed method demonstrates strong generality. ASVC can be directly integrated as a plug-and-play module into various Flow Matching policies. The authors validate its effectiveness across three distinct types of policies—ReinFlow, GFP, and Diffusion Policy—while introducing only modest additional inference overhead on real-world robot hardware.
Critical weaknesses
-
The gating condition of Residual Projection lacks a rigorous mathematical justification. In Section 3.3, the authors project the current velocity onto the residual direction and determine whether the current velocity deviates from the reference velocity based on whether the projection value falls below a threshold (defaulting to ). However, is mathematically equivalent to , which does not correspond to and pointing in opposite directions. For instance, when both velocities point in the exact same direction but the reference velocity has a smaller magnitude, , and the gate will still be triggered; conversely, does not guarantee that the two velocities share the same direction. This issue directly undermines the soundness of the core gating mechanism in ASVC and requires further clarification from the authors.
-
Lack of a critical Reference-only baseline. ASVC relies on an additionally trained reference mapping to restore test observations close to the training visual distribution, yet the paper does not report the results of directly generating actions from the restored observations under visual shifts, and the validation of the reference mapping is conducted solely on training frames. Consequently, it is currently impossible to determine whether the performance gains stem primarily from visual restoration or from the proposed velocity correction mechanism. Notably, in the real-world robot experiment under lighting variations, the fire of ASVC reaches 100% when , under which the method is strictly equivalent to integrating the velocity field corresponding to the reference observations throughout the entire process. Under shifted conditions on DMC-GB2, the fire also mostly fall within the range of 0.5–0.9, indicating that most integration steps actually use the reference velocity. Therefore, the absence of a Reference-only baseline constitutes a significant experimental flaw.
Questions for authors
-
The gating condition of Residual Projection lacks a rigorous mathematical justification. In Section 3.3, the authors project the current velocity onto the residual direction and determine whether the current velocity deviates from the reference velocity based on whether the projection value falls below a threshold (defaulting to ). However, is mathematically equivalent to , which does not correspond to and pointing in opposite directions. For instance, when both velocities point in the exact same direction but the reference velocity has a smaller magnitude, , and the gate will still be triggered; conversely, does not guarantee that the two velocities share the same direction. This issue directly undermines the soundness of the core gating mechanism in ASVC and requires further clarification from the authors.
-
Lack of a critical Reference-only baseline. ASVC relies on an additionally trained reference mapping to restore test observations close to the training visual distribution, yet the paper does not report the results of directly generating actions from the restored observations under visual shifts, and the validation of the reference mapping is conducted solely on training frames. Consequently, it is currently impossible to determine whether the performance gains stem primarily from visual restoration or from the proposed velocity correction mechanism. Notably, in the real-world robot experiment under lighting variations, the fire of ASVC reaches 100% when , under which the method is strictly equivalent to integrating the velocity field corresponding to the reference observations throughout the entire process. Under shifted conditions on DMC-GB2, the fire also mostly fall within the range of 0.5–0.9, indicating that most integration steps actually use the reference velocity. Therefore, the absence of a Reference-only baseline constitutes a significant experimental flaw.
-
The real-world robot experiments evaluate the performance of ASVC under lighting variations and the introduction of distractors, but do not explicitly investigate changes in the workspace background. Could the authors evaluate the performance of ASVC under variations in the color and texture of the tabletop or surrounding background?
-
The simulation experiments are primarily conducted on three DMC-GB2 tasks: walker walk, walker stand, and finger spin. Could the authors provide additional evaluations on manipulation benchmarks (such as Meta-World or Adroit) under controlled visual appearance shifts?