- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Controlled Predictive Memory (CPM) for more robust memory compression in vision-language-action models. CPM trains a recurrent latent memory by predicting joint outcomes under fixed closed-loop programs, jointly with action imitation. Empirically, it outperforms history-based baselines on LIBERO, SimplerEnv-Bridge, RoboMME, RoboTwin 2.0, and LIBERO-Plus, as well as on real-world single-arm and bimanual tasks.
Critical strengths
-
S1. The problem is well-motivated and clearly defined. In partially observable manipulation, identical current observations can correspond to different histories, and action imitation alone does not explicitly encourage a recurrent memory to retain history-dependent information. This paper addresses it via Controlled Predictive Memory (CPM), which trains a recurrent memory by predicting joint outcomes under fixed closed-loop programs, jointly with action imitation.
-
S2. Consistent empirical gains. CPM outperforms strong history-based baselines on multiple simulation benchmarks and on real-world single-arm and bimanual tasks.
Critical weaknesses
-
W1. The advantage of the proposed predictive objective over simpler alternatives is unclear. CPM uses program-conditioned prediction of joint future observations to supervise history compression. However, the paper does not compare this objective against alternative approaches, such as action-conditioned outcome prediction or contrastive learning that distinguishes histories with similar current observations.
-
W2. The design of the control programs is insufficiently justified. The programs are constructed by fixing the flow-sampling noise of a frozen policy, yielding reproducible closed-loop behaviors. However, the paper does not investigate whether these programs induce sufficiently diverse behaviors or justify the choice of eight programs. It is also unclear whether fixing the sampling noise is important. Ablations on program construction, program diversity, and the number of programs would help clarify the necessity and robustness of this design.
Questions for authors
-
Q1. The paper compares CPM mainly against history-based baselines, but not against other forms of predictive supervision. How would it compare to action-conditioned future prediction or contrastive objectives that distinguish histories with similar observations? Without such comparisons, it is hard to tell whether the program-based formulation is necessary or just one of several viable designs.
-
Q2. The programs are constructed by fixing the flow-sampling noise of a frozen policy. How sensitive is CPM to the number and construction of these programs? Do the eight fixed-noise programs actually produce meaningfully different closed-loop behaviors? How much would performance drop with fewer programs or with a different construction strategy?
-
Q3. Fixed flow-sampling noise has no clear semantic meaning. Are there alternative ways to define the control programs that would work just as well?
-
Q4. The program library contains only eight arbitrarily chosen programs, so its behavioral diversity may be limited. Could this bias the prediction target and the learned memory? Action-conditioned prediction covers a much broader range of behaviors and avoids this selection bias. Can the authors explain why the fixed-program formulation is still advantageous?
-
Q5. Why exactly two steps? It is unclear whether two steps is a principled choice or just a convenient one.
-
Q6. The memory uses four slots, but this choice is not ablated. How does performance change with one, two, eight, or more slots? Does the number of slots interact with the number of programs?