- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates layer selection and fusion for the latent interface of VLA policies. Through systematic experiments, the authors find that layer fusion generally underperforms the best single layer, while the optimal layer varies across backbones and benchmarks. To enable efficient layer selection, they propose InfoNCE as a layer-quality proxy, motivated by an information-bottleneck equivalence. Experiments show that InfoNCE-based selection reduces GPU compute by 9–33× and achieves substantially lower selection regret than deepest-layer selection.
Critical strengths
- Systematic Evaluation of Layer Selection and Fusion: The paper provides a comprehensive comparison of single-layer interfaces and three existing fusion methods across three pretrained backbones and two manipulation benchmarks, using multiple training seeds and statistical analysis. This offers more reliable empirical evidence than prior studies with limited layer comparisons and single-seed evaluations.
- Practical and Efficient Layer Selection: The proposed InfoNCE-argmax selector avoids expensive policy training and closed-loop evaluations for every layer. It reduces GPU compute by 9–33× compared with exhaustive oracle sweeps while achieving substantially lower selection regret than deepest-layer selection.
- Consistent Empirical Validation of InfoNCE: The paper evaluates four layer-quality proxies and shows that InfoNCE has the most consistent positive correlation with downstream policy success across the evaluated backbones and benchmarks. This supports its practical utility for identifying effective latent interfaces.
Critical weaknesses
-
Gap Between IB Equivalence and Task Performance: Theorem 1 proves equivalence between the IB objectives (Eqs. 2 and 4), but neither objective is shown to be equivalent to its corresponding task loss (Eqs. 1 and 3). Moreover, the proposed InfoNCE-based selector does not explicitly optimize the IB compression term. Thus, the theoretical equivalence does not establish why a higher InfoNCE score should predict better downstream policy performance.
-
Potentially Under-optimized Fusion Baselines: The paper concludes that fusion generally underperforms the best single layer, yet does not demonstrate sufficient architecture-specific hyperparameter tuning. Extremely large performance drops (e.g., −53.0 percentage points in Table 1) also lack diagnostic analysis. These issues make it difficult to determine whether fusion is inherently less effective or simply insufficiently optimized.
-
Missing Comparisons with Simple Action-Aware Probes: Although InfoNCE is compared with DiME and entropy-based metrics, the paper does not evaluate simple action-conditioned probes, such as linear action regression. Without such baselines, it remains unclear whether InfoNCE itself provides an advantage over simpler methods that exploit the same action supervision.
-
Limited Methodological Novelty: The method applies the established InfoNCE objective [1] to intermediate VLM representations, while its theoretical formulation builds on existing IB frameworks [2, 3]. The contribution therefore lies mainly in applying and evaluating existing techniques for VLA layer selection, rather than introducing a fundamentally new methodology.
References
[1] van den Oord et al., Representation Learning with Contrastive Predictive Coding, arXiv, 2018.
[2] Alemi et al., Deep Variational Information Bottleneck, ICLR, 2017.
[3] Kawaguchi et al., How Does Information Bottleneck Help Deep Learning?, ICML, 2023.
-
Limited Generalizability Beyond Frozen Backbones: All experiments use frozen VLM backbones. Since fine-tuning can change intermediate representations and their usefulness for action prediction, it remains unclear whether the conclusions about single-layer superiority and InfoNCE-based selection extend to end-to-end trained VLA models.
Questions for authors
- The Data Processing Inequality implies that mutual information between intermediate representations and expert actions cannot increase with layer depth for deterministic backbones. How do the authors explain the non-monotonic InfoNCE scores observed across layers, and what evidence supports their hypothesis that optimization limitations of InfoNCE critics align with those of downstream action heads?
- What factors explain the substantial variation in optimal layer depth across backbone–benchmark pairs (e.g., Qwen selecting L3 on LIBERO versus L16 on CALVIN)? Can these differences be attributed to backbone pretraining, task characteristics, or representation properties?
- Can the authors provide direct evidence that adding layers introduces action-irrelevant information, as hypothesized in Section 3.1, rather than merely making representations harder for the action head to decode or optimize?