- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper trains sparse autoencoders (SAEs) on two open source frontier VLA models: OpenVLA-oft and Pi05. A common phenomenon when VLA models are fine-tuned on small non-diverse dataset is a loss of generality [LIBERO-PRO Xueyang Zhou 2025]. The authors investigate this by comparing the activations of features across clean episodes and perturbed episodes (perturbed covering camera, background, light and sensor). They find that certain features can reliably detect the presence of perturbations, terming these detector features. They also find another class of feature which they term compensator features that by steering can improve success rate on perturbed episodes.
Critical strengths
Understanding the mechanisms behind VLA brittleness is an incredibly important pursuit. I find the paper to be well motivated, and the abstract and introduction to be clear and educational.
The paper includes code and experimental outline in the appendix sufficient to replicate this work.
Critical weaknesses
No strong baseline to the detector features is presented. If the authors are claiming that SAE features can detect perturbation signals they should compare against competent baselines like linear probes. The raw residual baseline is not a fair comparison.
The improvements of steering features on task success rate is very small and virtually identical to the random SAE feature baseline. 79.0% success rate unsteered versus 79.9% steered. Which is less than 1%. (Table 4.). It is also unclear how many trials each success rate in the table represents. At the top of the section it says that “All experimental results are averaged over three trials“, does this mean three trials across every task in the LIBERO-Plus dataset ? Again Table 6 shows small, but consistent changes in success rate. Including the number of trials and confidence intervals would strengthen the paper. I understand this information may be in the appendix, but it is difficult to parse all 20 pages for this review.
I have some fundamental concerns about the selection of the compensator features. Since they are all evaluated in closed loop on the same set of tasks before being chosen, it is difficult for them not to improve slightly on the base policy. The authors state that they select and test the top .1% of features, which could be hundreds of features. Even if the true effect is zero, selecting the best feature across N candidates with some random noise we would expect to see a slight improvement over the base policy. To alleviate these concerns the episodes / tasks that these features are calibrated on need to be different from the episodes/tasks that the success rate is evaluated on.
Results are limited in scope as they only apply to a single, often overfit [LIBERO-PRO Xueyang Zhou 2025] simulation environment. It would significantly strengthen the paper to include hardware both in the small dataset scale (to replicate the sort of overfitting which is occurs in LIBERO) and then additionally on a large scale dataset such as DROID (for which there are available FTs of Pi and OpenVLA).
Questions for authors
The compensator features are chosen by closed-loop screening over potentially hundreds of features. Are the tasks used to screen these features disjoint from those used to compute the success rates in Table 4 and Table 6 ?
Why is no baseline against linear probes or individual MLP neurons included for the detector features ? The raw residual baseline seems quite weak and not comparable to SAE features.