- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Optimus-R, a memory-centric VLA framework that formulates robotic adaptation as explicit query-skill memory tuning. The framework introduces an Inline Memory Interface for skill extraction, a Query-Skill Memory Bank for skill learning, and a lightweight Bridge-and-Adapt mechanism for skill updating. Experiments on in-domain adaptation, cross-domain adaptation, and lifelong learning show that Optimus-R enables data-efficient skill learning while mitigating catastrophic forgetting.
Critical strengths
-
The paper proposes an effective memory-centric framework for VLA adaptation, addressing an important problem in robot learning. The framework demonstrates computational efficiency and can be applied to multiple adaptation settings.
-
The empirical evaluation shows consistent improvements in success rates across different settings, including in-domain adaptation, cross-domain adaptation, and lifelong learning. The method is evaluated on multiple simulation benchmarks (LIBERO, CALVIN, and RoboTwin 2.0) and nine real-world manipulation tasks.
Critical weaknesses
- Insufficient evidence to support the core claims.
The paper claims that the proposed memory-centric framework enables efficient adaptation while mitigating catastrophic forgetting, but the experiments do not fully substantiate these claims. In particular, Stage B updates the VLA backbone during cross-domain adaptation, making it difficult to isolate the contribution of the memory mechanism from conventional fine-tuning. It also remains unclear whether the framework can effectively mitigate forgetting under domain shifts, as the forgetting analysis is limited to in-domain lifelong learning. Furthermore, the current ablations do not establish whether the explicit Query-Skill Memory Bank is necessary, as there is no comparison with memory-free latent conditioning under a matched training protocol. Consequently, it remains unclear whether the reported improvements primarily stem from the proposed memory mechanism or from additional model adaptation and training.
- Insufficient comparisons with relevant baselines and unclear novelty.
The experimental comparisons are insufficient to establish the advantages of the proposed framework over existing continual learning and memory-based adaptation methods. In the lifelong learning experiments, the main direct baseline is $\pi$0.5 fine-tuning, without comparisons to established continual learning approaches such as experience replay, regularization-based methods, or task-specific adapters. Moreover, the proposed approach shares conceptual similarities with prompt tuning and existing memory-based methods, but its distinction from these approaches is not sufficiently clarified or experimentally validated. The current experiments also do not adequately distinguish whether new-task improvements arise from reusing previously learned skills, expanding the memory bank with new prototypes, or latent exemplar replay. These limitations weaken the evidence for the claimed benefits and novelty of the proposed framework.
Questions for authors
- Some symbols in Figure 2 are difficult to interpret, particularly the question marks shown in the memory bank and retrieval components. What do these symbols represent? Are they placeholders for unknown values?
- How does Optimus-R compare with recent continual learning methods, particularly replay-based approaches or task-specific adapters?
- Many of the real-world tasks involve pick-and-place operations or their compositions. How well does the proposed memory mechanism generalize to more complex tasks requiring long-term dependencies or diverse skill compositions?
4 comments
Response to Reviewer njgE (2/2)
W3 & Q2: In the lifelong learning experiments, the main direct baseline is π0.5 fine-tuning, without comparisons to established continual learning approaches such as experience replay, regularization-based methods, or task-specific adapters. How does Optimus-R compare with recent continual learning methods, particularly replay-based approaches or task-specific adapters? The current experiments also do not adequately distinguish whether new-task improvements arise from reusing previously learned skills, expanding the memory bank with new prototypes, or latent exemplar replay.
R3: (1) Optimus-R has lower measured forgetting than both evaluated continual-learning baselines. In Table R3 (refer to R7 of Reviewer TEuW), all three methods use the π0.5 backbone. Optimus-R has lower NBT and higher final success in the ten-task simulation sequence. In the real world, its Category A forgetting is 5.00 points versus 8.75 and 10.00, while its Category B success is 57.0% versus 55.0% and 53.0%. It therefore has the lowest measured forgetting and the highest new-task success, exceeding raw replay by two points and prototype-routed adapters by four points. Moreover, in Table 9 of Appendix G.1, removing exemplar storage reduces full-data LIBERO success from 97.8% to 96.3%, supporting its contribution in that separate setting.
(2) Cross-suite transfer provides evidence consistent with selective skill reuse before bank expansion. In Table 12 of Appendix G.4, we train on LIBERO-Spatial and test on LIBERO-Goal. Before Goal training, the shared bowl-on-plate operation reaches 68% success versus 8% suite-wide. After adaptation, suite-wide success reaches 96% and the bank grows from 16 to 27 entries. The zero-shot result is consistent with transfer of a familiar operation, and the broader gains coincide with bank expansion and target-task training. As described in Sec. 3.4 of the main text and Appendix C.4, a close match updates an existing prototype and a sufficiently supported novel cluster adds an entry.
W4: Moreover, the proposed approach shares conceptual similarities with prompt tuning and existing memory-based methods, but its distinction from these approaches is not sufficiently clarified or experimentally validated.
R4: The revision discusses L2P and IsCiL in Sec. 2 of the main text (refer to R6 of Reviewer TEuW). L2P retrieves prompt tokens, and IsCiL retrieves a prototype to select a skill-specific adapter. As described in Secs. 3.1–3.3 of the main text, Optimus-R retrieves an action-supervised skill value that conditions a shared action expert. Table R3 (refer to R7 of Reviewer TEuW) reports lower forgetting than the prototype-routed adapter baseline, with higher final simulation success and higher real-world new-task success. Table R4 reports higher LIBERO-Long success than direct latent conditioning.
Q1: Some symbols in Figure 2 are difficult to interpret, particularly the question marks shown in the memory bank and retrieval components. What do these symbols represent? Are they placeholders for unknown values?
R5: The small lowercase in Figure 2 of the main text denotes a query. The question marks may result from how the PDF viewer renders the figure font. We verified that the labels render correctly in Google Chrome. The current query is , and each bank entry pairs the retrieval key with its skill value . The shapes in the retrieval panel illustrate groups of latent embeddings. As described in Sec. 3.3 of the main text, the aligned query selects keys whose skill values condition the action expert.
Q3: Many of the real-world tasks involve pick-and-place operations or their compositions. How well does the proposed memory mechanism generalize to more complex tasks requiring long-term dependencies or diverse skill compositions?
R6: (1) As described in Appendix F, Category B tests bimanual coordination and sequences of dependent actions. Table 8 and Figure 8 in Appendix F show tasks such as Sequential Pick and Place, which requires moving multiple objects to different targets in order. In Table 2 of the main text, we compare methods with 80 demonstrations per task. Optimus-R reaches 55% on Sequential Pick and Place and 50% on Bimanual Coordination Sequential Task, versus 45% and 40% for π0.5. These results show gains on both coordinated and sequential tasks.
(2) Category A tests whether the same operation transfers across object instances and layouts. The operations are listed in Table 8 in Appendix F. At each rollout, we vary lighting and object shape, color, and position. In the 80-demo comparison in Table 2 of the main text, Optimus-R reaches 85–90% success across the four Category A tasks under these variations.
Thank you for the responses and additional experiments. I appreciate the new comparisons with memory-free latent conditioning and continual learning baselines. These results partly address my concerns.
I'm still concerned about the novelty and advantages of the proposed memory mechanism. While Table R4 demonstrates improvements over direct latent conditioning, the gain is relatively modest and evaluated only on LIBERO-Long. Although the cross-task transfer results are promising, they do not fully isolate the contribution of reusing existing skill prototypes from the generalization capabilities of the pretrained VLA.
Overall, the additional experiments strengthen the empirical evaluation, but I believe the evidence for the distinct strengths of the proposed memory-centric design remains somewhat limited. I will maintain my original score.
Thank you for your follow-up comments. We address the remaining concerns below.
(1) Our comparisons evaluate the memory mechanism against both π0.5 and direct latent conditioning. Tables 1 and 2 of the main text compare the complete framework with π0.5, while the memory-free control tests bank retrieval against direct conditioning. We have extended this comparison to all four LIBERO suites.
Table R5. LIBERO success rates (%). The π0.5 and Optimus-R entries are from the full-data setting in Table 1 of the main text.
| Method | Spatial | Object | Goal | Long | Average |
|---|---|---|---|---|---|
| π0.5 | 98.8 | 98.2 | 98.0 | 92.4 | 96.9 |
| Memory-free latent conditioning | 98.6 | 98.4 | 97.6 | 91.4 | 96.5 |
| Optimus-R | 99.2 | 99.4 | 98.4 | 94.2 | 97.8 |
The experimental results show that direct latent conditioning degrades VLA performance, whereas explicit skill modeling and the use of a memory bank improve it.
(2) The component ablations test how the memory mechanism learns, organizes, and adapts skills. In Table 4 of the main text, removing Inline Memory tests the inline representation pathway, coupling query and skill tests their separation, removing prototype residuals tests local skill refinement, and removing the Stage-B Bridge tests cross-domain alignment under the same backbone updates. In Table 9 of Appendix G.1, removing skill-aware clustering tests prototype construction, removing exemplar storage tests latent replay, and uniform downsampling tests motion-aware sample selection. Each ablation reduces success. Table 10 of Appendix G.2 additionally examines sensitivity to bank capacity and retrieval configuration.
(3) The π0.5 comparison measures transfer beyond the pretrained VLA baseline. In Table 15 of Appendix G.7, both methods start from π0.5-base and follow the same Spatial→Goal sequence with matched demonstration budgets and training steps. Optimus-R achieves 95.0% SR on Goal vs. 93.8% for π0.5 and reduces Spatial forgetting from 7.2 to 2.8 points. These results demonstrate additional adaptation and retention benefits over the pretrained baseline.
We hope these clarifications address the reviewer’s concerns, and we would be happy to provide further clarification if the reviewer has any additional concerns. If your concerns have been addressed, we would greatly appreciate it if you could consider giving us a higher rating.
Response to Reviewer njgE (1/2)
Thank you for the thoughtful review and constructive suggestions. We have responded to your concerns as follows, and we have revised the manuscript accordingly. We would greatly appreciate it if you could consider giving us a higher rating.
W1: In particular, Stage B updates the VLA backbone during cross-domain adaptation, making it difficult to isolate the contribution of the memory mechanism from conventional fine-tuning. Furthermore, the current ablations do not establish whether the explicit Query-Skill Memory Bank is necessary, as there is no comparison with memory-free latent conditioning under a matched training protocol.
Table R4. Bank retrieval versus direct latent conditioning on LIBERO-Long.
W2: It also remains unclear whether the framework can effectively mitigate forgetting under domain shifts, as the forgetting analysis is limited to in-domain lifelong learning.
W3 & Q2: In the lifelong learning experiments, the main direct baseline is π0.5 fine-tuning, without comparisons to established continual learning approaches such as experience replay, regularization-based methods, or task-specific adapters. How does Optimus-R compare with recent continual learning methods, particularly replay-based approaches or task-specific adapters? The current experiments also do not adequately distinguish whether new-task improvements arise from reusing previously learned skills, expanding the memory bank with new prototypes, or latent exemplar replay.