- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RedFlow, an offline post-training framework for flow-matching VLA policies. It matches action chunks with similar task progress and robot proprioceptive states, estimates their quality using local progress changes and trajectory outcomes, and constructs corrective targets from higher-quality actions. The policy is trained to reinforce good actions, suppress low-quality actions, and redirect correctable actions toward these targets. Experiments on four LIBERO suites and three real-robot manipulation tasks demonstrate improved success rates and sample efficiency without additional human intervention or online data collection during post-training.
Critical strengths
- RedFlow learns from mixed-quality rollout data without requiring additional human interventions or online data collection during post-training, improving the utilization of existing experience.
- The method is evaluated across four LIBERO suites and three real-robot tasks, with consistent improvements over the base policy. Ablation studies further examine the contributions of context matching and action-level correction.
Critical weaknesses
- The method matches action chunks based on task progress and robot proprioception, without accounting for object poses or contact states. However, similar task progress and robot configurations do not necessarily imply similar corrective actions, as differences in object positions or contact conditions may require different actions. Averaging higher-quality actions within a matched cluster may produce invalid corrective targets.
- FlowPRO (https://arxiv.org/pdf/2606.05468) already studies offline post-training of flow-matching VLAs using paired successful and failed trajectories, while VINE(https://arxiv.org/pdf/2512.03913) leverages mixed-quality demonstrations for failure-aware planning. Although RedFlow introduces context-matched corrective targets and action-level redirection, the paper could better establish how these components provide a sufficiently distinct methodological advance beyond existing approaches.
Questions for authors
- By weighting and averaging the high-quality actions within the same matching cluster, why can this lead to effective error correction actions? If these actions are very different from each other, even corresponding to different operation methods, will the averaged action still be executable?
- The paper only uses the task progress and the robot's own state for matching. If the positions or contact conditions of the two objects are different, how can the method ensure that the matched action is still suitable as a reference for error correction?
- The paper assesses the quality of actions based on the changes in the progress of local tasks and the success or failure of the entire trajectory. If a trajectory ultimately fails, but some of the actions within it are actually correct and can be learned, how can the method avoid mistakenly labeling these actions as of low quality?
Thank you again for your thoughtful feedback. If you have any remaining concerns or further suggestions, we would greatly appreciate hearing them while there is still time to make revisions, as we hope to address your questions as fully as possible.