- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work leverages the WAM for generative replay, in continual robot learning tasks.
R2-WAM uses the WAM (e.g., LingBot-VA) to imagine rollouts per learned task, then does some filtering to remove most inconsistent ones according to a simulator, and discards unsuccessful traces.
Results wise, on four ten-task LIBERO suites, it reaches 92.7% average final success, 20% above without generative replay, and 2 points below than storing real equal size data (equal in the sense of imagined traces). The authors further analyzed that the forgetting concentrates in inverse dynamics.
My own concern is that this is still not a very scalable way for true continual learning, as learning every task requires a few hours of finetuning the WAM. And though the buffer size is matched, it only means the authors compare using the same amount of imagined versus real data. However, this calculation omits the additional storage overhead of the WAM, which significantly exceeds the base data storage in short task sequences (though this is a common problem in all generative replay methods).
Critical strengths
-
Solid and strong results in a practical setting: without any old-task data, R2-WAM reaches 92.7% average SR (NBT 2.33), against 94.6% for ER and 70.4% for raw generated replay, all measured with multiple seeds.
-
Each rectification step has direct support. On LIBERO-Spatial, removing truncation drops SR from 94.0 to 70.8 and removing filtering to 80.8. Also, I particular thank the authors for providing the per-task tuning cost in terms of gpu hours.
Critical weaknesses
As I mentioned, my own concern is that this is still not a very scalable way for true continual learning, as learning every task requires a few hours of finetuning the WAM. And though the buffer size is matched, it only means the authors compare using the same amount of imagined versus real data. However, this calculation omits the additional storage overhead of the WAM, which significantly exceeds the base data storage in short task sequences (though this is a common problem in all generative replay methods).
On the other hand, some minor things worth checking, for REGEN (Sec 4.1–4.2 of the paper), it should start from real observations of the current task and retain no previous-task trajectories, i.e., it is already data-free?
The claim that forgetting “concentrates in inverse dynamics” compares quantities on different scales. Fig. 7(a) contrasts 8% retained task success with 78% retained PSNR, but a PSNR ratio is not a fraction of ability retained: PSNR is logarithmic and stays well above zero even for poor predictions, while success can fall to zero. Please report raw PSNR/MSE against a trivial-predictor baseline, or limit the claim to the qualitative evidence in Fig. 7(b).
Questions for authors
See weakness.
Dear Reviewer Ekze,
We understand how busy this period is and are truly grateful for your time. We have worked hard to address each of your comments, with new experiments and a revised paper. As the discussion period closes on November 18 (AoE), even a brief note from you would mean a great deal to us. If our responses have resolved your concerns, we would sincerely appreciate it if you would consider raising your score.
Best regards,
The Authors