- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work introduce Action-Future Coupled Effect Learning (AFCE) method, which makes a future-grounded physical effect the policy's primary prediction target. AFCE introduces Effect tokens as the primary prediction target for VLA policies. Offline tokenizers extract temporally ordered effects from demonstrations and robot responses. A state-conditioned decoder converts these effects into action chunks. The method achieves 50.97% success on DexJoCo, outperforming existing baselines. It also leads on all five bimanual tasks.
Critical strengths
-
Well-motivated policy supervision. AFCE combines actions, realized robot responses, and visual transitions into an action-decodable target, incorporating physical consequences into policy learning without requiring future observations at inference.
-
Promising bimanual results. AFCE achieves 37.33% bimanual success, outperforming the evaluated π₀.₅ (9.73%) and UVT (14.53%) baselines on all five tasks. These gains demonstrate its potential for coordinated manipulation.
Critical weaknesses
-
Insufficiently specified controls limit attribution of the gains. The main comparison uses an officially released π₀.₅ multitask checkpoint, while the training configuration of the UVT baseline is insufficiently documented. It is therefore difficult to establish how closely optimization, task sampling, and adaptation settings are matched. Table 3 is valuable: its group means imply approximately 45.27% overall success for the action-only variant, versus 50.97% for full AFCE. However, it is unclear whether removing a modality also removes its reconstruction objective. If future-response or visual reconstruction remains active, the action-only variant would still receive future supervision. Moreover, the reported evaluation-seed variation does not establish robustness across independent training runs. These uncertainties materially affect how confidently the improvement can be attributed to the proposed future-grounded target.
-
The executability diagnostic lacks a necessary reference. At the selected Effect dimension, ground-truth-Effect replay succeeds on only 25/110 training demonstrations, including 5/50 bimanual demonstrations. A raw-demonstration-action replay result under identical conditions is needed to interpret these numbers. Without that reference, it is difficult to determine whether failures arise primarily from representation and decoding errors or from the replay setup itself. The authors appropriately distinguish this diagnostic from closed-loop policy evaluation, but the central claim that the Effect preserves executable detail still needs stronger support. A controlled replay comparison would make this part of the contribution substantially more convincing.
Questions for authors
Clarification and targeted validation: In Table 3, does removing S or V remove only the encoder input, or also its reconstruction target and loss? Are the decoder architecture, Stage-II losses, and optimization settings otherwise unchanged? Can the full-AFCE versus action-only improvement be confirmed across independent training seeds? This would help establish the contribution of future supervision.
2 comments
Thank you for your questions about the ablations and replay evaluation.
- Modality ablations. Each ablation removes both the future modality input and its reconstruction loss. The decoder retains the current robot state.
- Controls. AFCE exceeded the action-only latent by 5.70 percentage points at seed 42 and outperformed Direct-A at all three training seeds.
- Replay reference. On the same 110 windows, demonstrated actions succeeded 67 times, ground-truth Effects 21 times, and predicted Effects 10 times.
As the discussion closes in a few hours, we would appreciate a brief reply on whether these clarifications resolve your concerns.
Response to Reviewer XenN: Effect Construction, Matched Comparisons, and Replay Analysis
We thank the reviewer for the helpful questions.
W1 + Q1. Modality ablations and independent-run comparison. Removing S or V removes both the corresponding future-evidence input and its Stage-I reconstruction objective. The current robot state remains available to the action decoder in all variants; the Stage-II decoder, losses, and optimization settings are unchanged.
The single-checkpoint modality ablation gives 45.27% overall for A-only latent and 50.97% for Full AFCE (+5.70 pp; +5.11 pp single-arm and +6.40 pp bimanual). To assess variation across training runs in the comparison with direct action prediction, we train Direct-A and Full AFCE using the same three training seeds:
Full AFCE achieves higher overall success than matched direct-action prediction for each of the three training seeds. Direct-A and A-only latent are distinct controls: the former predicts actions directly, whereas the latter predicts an Effect constructed from action evidence only. We report the A-only latent result as a target-construction ablation, not as a multi-seed result.
W2. Raw-action replay reference. On the same 110 demonstration windows and initial states (H=30), raw demonstrated actions succeed in 67/110 cases (60.9%), GT-Effects in 21/110 (19.1%), and predicted Effects in 10/110 (9.1%). The 25/110 result in Table 2 uses the Stage-I snapshot of the same decoder; the 21/110 result uses its jointly adapted Stage-II snapshot. In Effect replay, the Effect sequence follows demonstration time steps and the decoder uses the current robot state. This fixed-sequence diagnostic differs from the 50.97% closed-loop result, where the policy predicts Effects from current observations and replans. The gap from raw-action replay indicates remaining execution degradation in the Effect-to-action pathway; GT-Effects nevertheless yield higher replay success than predicted Effects under the same protocol.