- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
This paper introduces CausalProbe, a framework for representation-level causal analysis via subspace erasure for vision models
Critical strengths
The paper tackles a very interesting and timely problem of understanding the 'world models' inside vision models. Particularly, moving from correlative to causal analysis is super important and the paper addresses this head on.
The two tasks (suction affordance and future contact prediction) are sufficiently diverse and also targeted in my mind. And the second-order dimensionality result is impressive and interesting! A 10 dimensional subspace is sufficient for removing grasping affordance.
I also found the experimental procedure detailed yet sound. The control vs erasure iterative procedure is a solid methodology in my opinion.
In general, I am quite positive about the paper but have a few concerns that, if addressed, would raise my score.
Critical weaknesses
I am a bit concerned about the mixed results for separating out spatial and motion information. I appreciate the authors being upfront about the entanglement of the two, which is to be expected, but it is important to have a more detailed analysis and leverage additional existing metrics along this line to better understand how the information is tangled; across layers, neurons, etc. For example, Kowal et al (2022) provide a metric for doing so that could help quantify this is a more finegrained manner. It would be ideal to relate task degradation to achieved target suppression in the results here to get a sense of the specific trade-off.
It remains unclear how much Physion++ contact prediction depends on temporal information, since late-frame spatial cues may already support the task (e.g., via camera motion blur or spurious correlations in the data). A useful experiment would compare the full-video input with the last visible frame repeated across the input sequence, retaining the same target–zone cue and retraining the contact head under identical splits. Similar AUROC would suggest that temporal history contributes little in this setup, limiting what the weak motion-erasure effect reveals about the models’ physical reasoning.
[a] Kowal et al. A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic Information (CVPR 2022)
Questions for authors
The following are two extensions; either of which would significantly strengthen the paper:
Could we discover the physics subspaces? Existing work has discovered multidimensional subspaces in vision models. (https://github.com/goodfire-ai/block-sparse-featurizer) BSFs applied to the model, rank subspaces based on their alignment with probes, then remove. This would show we can discover these physical variables unsupervised to some degree.
Diff of means vs. probes. The authors only use probes, which are good for detection (filtering). But since decoding weights can differ from the activation patterns associated with a variable, it would strengthen the attribution results to repeat representative interventions using an alternative direction estimator, such as Haufe-transformed patterns or an appropriate mean-difference/forward-encoding baseline [b].
[a] Fel et al. Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds (Arxiv 2026) [b] Haufe et al. On the interpretation of weight vectors of linear models in multivariate neuroimaging. (NeuroImage 2014)
Response to Reviewer GL5S (part 2)
2. Quantifying entanglement and relating suppression to task loss — Critical Weakness 1
We added quantitative subspace-overlap measurements and an intermediate-layer analysis. Section 5.3.3 and Fig. 9 compare normalized principal-angle overlap between the two families’ decoder subspaces, using rank- and dimension-matched random subspaces as references. Position–velocity overlap exceeds first-/second-order geometry overlap in all six encoders, including after chance adjustment (Appendix J). This provides quantitative evidence consistent with the stronger constraints that protection imposes in the position–velocity experiments.
We additionally analyze V-JEPA 2 blocks 8, 16, and 24 for both the original spatial/motion descriptors and the revised position/velocity variables (Appendix K, Fig. 56). Position prediction improves across these blocks, whereas velocity prediction peaks at the intermediate block. Position–velocity decoder overlap is nonmonotonic and remains above the random-orientation range throughout. These results distinguish changes in predictability from changes in subspace alignment. The measurements concern predictive subspaces rather than individual-neuron selectivity.
Figure 8 now directly plots task loss against achieved target-prediction loss. Each point corresponds to an erasure rank, with protected and unprotected trajectories overlaid for each variable and encoder. This separates the amount of information suppressed, as measured by the probes, from the number of erased directions.
For position erasure, greater suppression generally accompanies greater task loss. For velocity erasure, protection restricts target suppression in every encoder and task loss in five; VGGT exhibits the opposite task-loss ordering. Together with the control-prediction curves in Fig. 5, these comparisons clarify when greater task impairment accompanies both stronger target suppression and collateral effects on the related variable.