- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces R$^2$-WAM, which is built on a function-structured adapter for world-action models (WAMs) that enables reusable experience for new few-shot tasks. It ranks historical residuals route-by-route with first-order target-loss scores, learns task-specific compositions, and adds a group-shared new residual with task-specific exposure for missing capabilities. R$^2$-WAM requires only saved adapters, without needing historical data. Experimental results on LIBERO and RoboCasa365 demonstrate that R$^2$-WAM achieves improved success rates compared to fresh adapters, pooled-data initialization, and random historical support.
Critical strengths
-
The paper addresses an important problem in few-shot robot policy adaptation by exploring how previously learned adapters can be reused to facilitate adaptation to new tasks without retaining historical training data.
-
The experiments on LIBERO and RoboCasa365 demonstrate the potential of the proposed approach to improve few-shot adaptation performance.
Critical weaknesses
1. Insufficient comparisons and experimental evidence.
The paper lacks direct comparisons with existing approaches for historical adapter reuse, composition, and continual learning. The experiments do not sufficiently establish the advantages of R$^2$-WAM over existing methods under matched training conditions. Furthermore, the ablation results do not fully clarify the contributions of the proposed components. For example, the new-residual-only variant performs substantially worse than fresh structured adaptation, making it difficult to isolate the benefits of historical reuse from differences in parameter sharing and optimization.
2. Limited validation of the claimed long-term experience reuse and accumulation.
The main experiments rely on a fixed, manually constructed historical adapter bank, without evaluating how the framework performs as new adapters are progressively added. Although Section 6 discusses experience persistence, folding, and bank expansion, these mechanisms are not validated through corresponding closed-loop experiments. Moreover, the evaluation relies on manually organized task groups with shared operation structures, leaving the applicability to more diverse and less structured task distributions unclear. Consequently, the experiments support few-shot adaptation from a fixed historical bank but do not fully substantiate the broader claims of continual experience accumulation and reuse.
3. Unclear presentation.
The paper is difficult to follow due to unclear explanations, excessive technical details, and an overly complicated methodological narrative. In particular, the relationships between the function-structured adapter, historical residual composition, and target-group refinement are not clearly motivated, making it difficult to distinguish the core technical contributions from implementation details. The discussion of related work is also insufficient. Although several relevant methods are mentioned, their differences from the proposed framework are not adequately explained. These presentation issues make it difficult to assess the novelty and significance of the proposed contributions.
Questions for authors
-
How does R$^2$-WAM compare with existing methods for historical adapter reuse and composition, such as LoRAHub and continual-learning approaches?
-
How sensitive is R$^2$-WAM to the size, diversity, and quality of the historical adapter bank? Does performance consistently improve as more historical adapters become available, or can irrelevant adapters introduce negative transfer?
-
Why does the new-residual-only variant substantially underperform fresh structured adaptation?
10 comments
A1 (W1, Q1): Motivation, problem formulation, and comparison with prior methods (Part 2)
Matched composition comparisons. All methods use a Top-4 candidate budget per route, with the same anchor, historical bank, target demonstrations, and Stage-2 refinement. Uniform and NGOpt share R²-WAM's route-wise candidates, while WQ uses a single whole-adapter candidate set shared across routes.
| Method | Overall SR (35 tasks) |
|---|---|
| Uniform | 60.6% |
| NGOpt (LoRAHub-style) | 64.5% |
| Whole-adapter WQ | 61.4% |
| R²-WAM (GSC) | 72.2% |
Uniform fixes equal historical coefficients, NGOpt performs gradient-free coefficient optimization, and whole-adapter WQ shares historical candidates and coefficients across functional routes. R²-WAM outperforms these baselines by +11.6 pp, +7.7 pp, and +10.8 pp, respectively. Its advantage over whole-adapter WQ holds across all six target groups, supporting task-specific coefficient optimization and function-structured historical reuse.
A2 (W1, Q3): Component contributions and the residual-only performance gap
Historical selection, composition, and refinement. We distinguish the contributions of three key components:
- Historical reuse. The original trained-bank mean is +15.5 pp above the single-seed output-scale-matched random-bank result in task-weighted Overall SR (72.2% vs. 56.7%). This cross-protocol comparison is descriptive. Target-loss candidate selection improves success over random trained candidates by +6.5 pp (72.2% vs. 65.7%) in the original paper's mean results (Table 1).
- Task-specific composition. Table 2(a) shows that making composition coefficients task-specific, while retaining group-shared candidates and task-specific exposure, raises success from 58.7% to 72.2% (+13.5 pp), demonstrating the value of personalized historical combinations.
- New-residual refinement. Unlike prior NLP work where frozen-adapter composition alone enables effective few-shot transfer, bank-only composition achieves just 0.9% on our embodied targets (Table 1), highlighting the importance of learning capabilities absent from the historical bank.
Why new-residual-only underperforms fresh adaptation. Both methods train the same group-shared structured residuals, but new residual only retains the full method's task-specific learnable exposure , initialized at 0.1, after removing history. Fresh adaptation instead fixes . We compare the two exposure settings with and without history in Appendix D.5:
| Target group | No history, learned | No history, (Fresh) | With history, learned | With history, |
|---|---|---|---|---|
| Object | 59.0% | 72.6% | 85.6% | 65.4% |
| Goal | 27.7% | 75.0% | 76.7% | 85.0% |
| Long-C | 8.0% | 5.0% | 30.0% | 5.0% |
Without history, fixing recovers fresh adaptation and improves success on Object and Goal. This shows that their residual-only deficits depend on the exposure setting, rather than a different residual architecture. Object reverses this preference with history, favoring learned exposure over . Long-C also favors learned exposure with history, while full exposure alone does not overcome its low no-history success. Goal instead performs best with full exposure even when history is present. Thus, the preferred exposure setting depends on both historical support and the target group.
We therefore interpret new residual only as a history-removal ablation under the full method's exposure setting, and use fresh adaptation as the standalone baseline. The gain over new-residual-only should not be read as the gain over standalone adaptation. Section 5.3 now makes this distinction explicit.
Together, these experiments distinguish the contributions of historical candidate selection, task-specific composition, and exposure-controlled refinement.
We thank the reviewer for recognizing the importance of historical experience reuse in few-shot robot adaptation. We provide additional comparisons, examine historical-bank sensitivity, and clarify the method's technical contributions and evaluation scope. For your convenience, please also refer to our revised manuscript for the corresponding updates.
A1 (W1, Q1): Motivation, problem formulation, and comparison with prior methods (Part 1)
Motivation and adaptation-space design. Robot demonstrations are costly to collect, making few-shot adaptation of large WAMs challenging. Rather than incorporating all historical data into a single embodied pretraining stage, we organize accumulated experience by task groups and preserve learned capabilities as reusable adapters. New-task adaptation can then be formulated as recombining historical capabilities and learning corrections for missing ones.
This motivates a parameter-efficient, function-structured adaptation space. Unlike LoRA's low-rank weight updates, our adapter aligns nonlinear residual modules with WAM's video, context, and action routes to enhance expressivity. Since nonlinear residuals cannot generally be composed by directly merging their parameters, we combine their outputs in representation space. The resulting adapter achieves 97.2% versus 92.0% for LoRA on LIBERO-Object with 80 demonstrations (Section 5.2).
Three perspectives on historical experience. We distinguish three related optimization problems:
LoRAHub — Historical Composition. Given a frozen base model and historical LoRA bank B, LoRAHub optimizes target-specific composition coefficients:
wt∗=argminwtL(Dt;fbase,B,wt).
R²-WAM — History-Aware Adaptation. We formulate history-aware target-group adaptation over a function-structured residual space, jointly optimizing task-specific historical compositions and group-shared learnable corrections:
(α∗,η∗,ϕ∗)=argminα,η,ϕM1∑t=1ML(Dt;fanchor,B,αt,ηt,ϕ).
Here, αt,i,m learns task- and route-specific historical combinations, while the group-shared ϕ learns missing capabilities with task-specific exposure ηt.
Continual Learning — Sequential Model Evolution. Given a task stream D1→D2→⋯→DK, continual learning updates a persistent system from Sk−1 to Sk. A representative objective is Sk∗=argminSk[L(Dk;Sk)+λRretain(Sk,Sk−1)].
The two terms represent new-task learning and preservation of prior capabilities. Historical retention can be enforced through replay or frozen modules rather than an explicit regularization loss. DMPEL and CLARE study such evolving modular systems through expert routing and expansion.
Key distinction and motivation. LoRAHub and R²-WAM share a fixed-bank, target-given adaptation setting that reuses saved modules without accessing historical demonstrations during target adaptation. Their key difference lies in the optimization space. LoRAHub composes frozen historical modules, whereas R²-WAM jointly optimizes function-structured historical reuse and new learnable corrections to address unseen objects, semantics, and interactions that existing capabilities may not fully cover. Continual learning instead addresses sequential system evolution, balancing new-task acquisition with historical capability retention.
We study fixed-bank adaptation to isolate historical reuse from task-arrival order and old-task retention. Historical adapters are independently trained from a common anchor and treated equally during target-specific selection, regardless of acquisition order. This separates experience reuse from sequential bank maintenance and expansion, discussed in Section 6.