- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies incremental imitation learning under task drift, where a robotic policy must adapt to changing task conditions while retaining performance on previously encountered distributions. The authors formulate behavior cloning as tabular in-context regression using a pretrained TabPFN model. Visual observations are encoded using a frozen pretrained visual encoder, compressed through partial least squares (PLS) using expert action supervision, and combined with proprioceptive states to form feature-action tables.
The paper proposes two adaptation strategies: accumulating demonstrations in the model's context and maintaining a fixed-size learnable prompt updated through incremental prompt distillation. The latter uses the preceding prompt to preserve knowledge while incorporating demonstrations from the current distribution.
Experiments on six MetaWorld tasks with three sequential distribution shifts show strong performance. The incremental prompt-tuning method achieves 88.1% final success, compared with 47.5% for the strongest incremental baseline, while reporting a forgetting score of -3.8.
Critical strengths
- The authors use a pretrained tabular foundation model as an action predictor, which is a conceptually simple and potentially useful alternative to conventional robot-specific policy training. The method separates visual representation learning from the action prediction mechanism and exploits the ability of TabPFN to infer input-output relationships from labeled examples. This formulation is particularly attractive in settings where repeatedly training a policy after every distribution shift is undesirable.
- The fixed-size prompt-distillation approach provides a reasonable mechanism for retaining previously acquired information without storing historical raw demonstrations. The proposed objective combines prediction on new demonstrations with constraints derived from the preceding prompt, keeping the TabPFN predictor frozen.
Critical weaknesses
- The incremental experiments compare the proposed prompt-distillation method against R3M, BeT, ACT, and Diffusion Policy, which are sequentially fine-tuned using only the current distribution. However, the proposed method explicitly preserves information from previous distributions through a 512-row feature-action prompt, whereas the baselines do not receive comparable replay or persistent-memory mechanisms. Therefore, the large performance gap may reflect the availability of persistent memory rather than a specific advantage of tabular foundation models or the proposed distillation objective. The paper also lacks comparisons with simple nonparametric or tabular regression alternatives, such as nearest-neighbor regression, kernel ridge regression, or similarly compact exemplar-memory methods. These are particularly important because the central formulation reduces imitation learning to regression over low-dimensional feature-action pairs. Without such comparisons, it is difficult to identify the contribution of TabPFN itself. Additionally, there is no direct ablation removing the previous-prompt distillation term in Equation (11), which makes it difficult to quantify the importance of the proposed retention mechanism.
- The experiments are restricted to six MetaWorld tasks, each containing only three stages of geometric task drift. Although the results are encouraging, they do not establish that the method remains effective over substantially longer sequences, larger distribution shifts, or different robot embodiments. Moreover, the complete system is not independent of robot-specific learning resources: it relies on a visual encoder pretrained on robot-manipulation data and an action-supervised PLS projection fitted to the initial demonstrations. The latter remains frozen across subsequent task shifts, potentially limiting adaptation when newly relevant visual features are absent from the original representation. Finally, the reported negative forgetting of -3.8 +- 3.6 is relatively modest compared with its variability. The results clearly support reduced forgetting, but provide weaker evidence for robust backward transfer than the paper's wording suggests.
Questions for authors
- Can the authors compare against conventional policies equipped with a comparable persistent-memory budget, such as replay from stored feature-action examples, and against simple regression approaches using the same frozen representation? Additionally, what is the effect of removing the previous-prompt distillation term in Equation (11)? These comparisons would clarify how much of the improvement comes from TabPFN, persistent memory, and the proposed distillation mechanism, respectively.
- How does performance change when the number of drift stages increases beyond three? Since the PLS projection is fitted only on the initial distribution and then frozen, can the authors evaluate whether substantial later shifts introduce action-relevant visual information that the initial projection fails to preserve?
We thank the reviewer for the careful assessment and constructive suggestions. We have added several experiments and revised the manuscript to address the concerns.
Critical Weaknesses
EWC reduces forgetting and improves performance; for example, R3M's final success increases from 47.5% to 69.2%, while forgetting decreases from 59.9 to 26.0 points. However, substantial forgetting remains across all EWC baselines, and their performance remains considerably weaker than ours. Removing prompt distillation from our method increases forgetting and reduces final success from 88.1% to 76.1%. This confirms that prompt distillation contributes substantially to performance.
We also added nonparametric regression methods that retain and reuse demonstrations. All methods use exactly the same PLS features and proprioceptive state, isolating the effect of the action-prediction mechanism.
The nonparametric methods do not exhibit forgetting because they retain all demonstrations. Our method nevertheless achieves the strongest performance using the same representation and demonstrations. This supports a benefit from the pretrained tabular model beyond reusing prior examples.
Very small projection dimensions, such as 16, discard useful information, whereas 32–64 dimensions perform well. Performance can decline at larger PLS dimensions, suggesting overfitting due to the increased number of fitted parameters. The joint full-context variant avoids this overfitting issue when PLS is removed because the pretrained TabPFN predictor is used directly without optimization. However, using the full visual representation increases storage and computation: inference takes 1,666 ms, which is 9.15 times slower than the 182 ms required with the 32-dimensional PLS representation. We therefore use PLS because it maintains strong performance while being considerably more efficient.
Regarding backward transfer, achieving positive backward transfer remains challenging in continual learning, where most methods primarily aim to reduce forgetting. We agree that the observed negative forgetting of −3.8±3.6 percentage points provides limited evidence of backward transfer. We have therefore tempered the corresponding claim in the revised manuscript to avoid overstating this result.
Questions
Question 1 is addressed by the EWC, prompt-distillation, and nonparametric regression experiments above. Question 2 is addressed by the drift-construction explanation and PLS ablation above.
We hope these additional experiments and clarifications address the reviewer’s concerns. If so, we respectfully ask the reviewer to consider updating their score.