- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies continual RL on VLA models. While previous works have shown that CRL on VLA can be quite stable in terms of catastrophic forgetting, this paper argues that an overlooked problem is the plasticity. To ensure that plasticity is preserved during CRL process, the paper proposed a set of detection and plasticity preservation mechanisms, and tested them on the libero-spatial benchmark.
Critical strengths
- The motivation calling for a focus on stability in CRL is reasonable and important.
Critical weaknesses
- The writing regarding the connection between the motivation and the proposed method of this paper is hard to follow / understand
- It is not clear what part of the method is novel and what part of the method is directly taken from previous work.
- The experiment section of this paper has significant issue.
- Table 1 has several missing entries with comments like "Lost to an infrastructure fault" -- is this paper unfinished? (And the result doesn’t even support their claim)
- Table 4: Behavioral column is in caption but is absent from the table.
- 2 training epoches are very short; only tested on libero spatial.
- A very simple baseline they should have tested is sequential LoRA expansion with periodic merging.
Questions for authors
N/A. I suggest the authors to finish their experiments before submitting.