- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies continual imitation learning, where a robot is sequentially trained on new tasks while (optimally) retaining performance on previously learned tasks. In line with continual learning litreatures, it assumes that demonstrations from previous tasks are unavailable during adaptation, although storing them is possible in other continual-learning methods. ReGen uses a World Action Model to generate pseudo-demonstrations for previous tasks, predicting, not accessing future visual observations recursively. These synthetic trajectories are replayed with new-task demonstrations to reduce forgetting. The method improves retention over sequential fine-tuning, but generated observations can degrade and become inconsistent with the predicted actions.
Critical strengths
The RAR comparison and the gap between imagined and executed success clearly expose the limitations of generated replay, particularly visual degradation and action–observation inconsistency. I found this interesting, as I have not seen it in SOTA before.
Critical weaknesses
Soundness option: I have selected the option "I have minor or fixable concerns about the paper’s soundness." as I have only minor or fixable concerns regarding the paper’s technical soundness. However, the main weaknesses are not primarily about correctness: the methodological novelty is limited, and the experimental findings are largely unsurprising given prior work on generative replay and continual imitation learning. The paper does not convincingly establish a substantial advance over existing methods.
--- Weaknesses ---
The paper addresses a relevant problem, but its proposed solution is largely a straightforward application of recursive WAM generation to replay, and the experiments do not establish sufficient novelty or superiority over existing continual imitation-learning methods. Details are below:
W1) The central idea is not fundamentally new. Generative replay of previous robot-imitation trajectories has already been explored, e.g., in CRIL, which generated states and actions for replay using a generative model and an action-conditioned video predictor. ReGen mainly transfers this idea to a WAM backbone.
W2) The claimed novelty is therefore overstated. The paper should clearly distinguish the WAM-specific implementation from the broader, already established idea of generative replay for continual robot imitation learning.
W3) The experimental comparison is incomplete and outdated. Important continual-imitation baselines, including CRIL and more recent methods such as LOTUS, ISCIL, M2Distill, and MLR-IFA, are not evaluated. These papers report substantially broader comparisons on LIBERO-Object/Goal/50/100/LONG.
W4) The experimental setting is relatively narrow: six base tasks followed by only four continual stages in simulation, and three highly similar pick-and-place tasks on the real robot. The paper does not demonstrate robustness on longer or more diverse task sequences, e.g., comparable to LIBERO-50.
W5) The baselines (not SOTA, which is completely discarded as mentioned above) are not sufficiently strong to support the paper’s broad claims. The comparison is dominated by sequential fine-tuning, LoRA, EWC, and PackNet, while modern task-agnostic replay, distillation, latent-replay, and skill-based methods are absent.
W6) The method relies on strong and incompletely acknowledged scene assumptions. ReGen is initialized from observations containing the objects required by previous tasks; when these objects are absent, the method uses prior-task object metadata and simulator-rendered observations. This weakens the claim that replay requires no previous environment information.
W7) The paper does not isolate whether the gains come from ReGen itself or from the additional WAM architecture and auxiliary future-observation/reward objectives. A matched action-only policy and matched-capacity controls are needed. It is not clear whether other baselines are also based on WAM; thus, I am mentioning this.
W8) The generated replay is not reliably behaviorally grounded. The paper reports that 83% of generated rollouts appear successful visually, while only 42% succeed when their predicted actions are executed. It seems to me this means the replay targets can be visually plausible but physically incorrect.
Questions for authors
I do not have specific questions as I believe the paper is not yet mature and requires a lot of experiments and results, which might trigger questions, but not at the moment, tho all the weaknesses already listed above.