- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how conflicting texture and contour cues influence depth judgments in a vision–language model. Steering, ablation, and cross-layer restoration and transfer experiments suggest that selected features affect the output margin and that later features carry part of an earlier intervention’s effect.
Critical strengths
The paper addresses a worthwhile question: whether visual information identified in a representation actually contributes to the model’s judgment. Controlled cue conflicts provide a useful setting for investigating this distinction.
The restoration and transfer experiments are a thoughtful addition to feature visualization and ablation. Together, they offer some evidence for local dependencies between selected internal contributions.
Critical weaknesses
-
The restoration and transfer results provide evidence that selected later contributions can carry part of an earlier perturbation’s effect. What remains unclear is how specific this behavior is to the proposed depth features. The paper does not provide matched random-feature or unrelated-feature interventions with comparable activation levels, perturbation norms, and spatial coverage. A zero-dose control verifies that an unchanged activation yields an unchanged result. It does not establish that the selected direction has a distinctive functional role.
-
There is also a missing connection between manipulating an image cue and steering an SAE feature. The upstream perturbation is introduced directly into the hidden state, and the paper does not show that it reproduces the internal change caused by modifying the actual texture or contour. Paired image interventions would help establish whether the identified paths participate in processing naturally occurring cue changes.
-
Averaging semantically reoriented margins produces a numerical score, but the paper has not established that changes in this score reliably reflect changes in concave or convex interpretation. The experiments demonstrate that selected visual-encoder interventions affect the output. Assigning those effects a stable depth meaning requires further validation. I would like to see absolute logits before and after intervention for each mapping, together with alternative prompts or direct semantic answer scoring. An intervention need not reverse the final answer to be informative, but its semantic direction should survive a change in option order.
Questions for authors
See Weaknesses
Dear authors, it looks like you haven't responded to reviewer concerns yet. As the rebuttal phase is nearing its end, this is your last chance to respond - alternatively, I would suggest to consider withdrawing the paper if you don't believe it has a chance of acceptance.
Thank you,
Your AC