- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
This paper aims to investigate how training examples influence predictions in vision-language models, with a focus on the relationship between these influences, internal features, image regions, and textual content. The authors propose MOSAIC, a method that combines sparse autoencoders with training-data influence estimation. By introducing spatial sparsity constraints and cross-modal alignment, the method learns shared latent features across images and text. It then traces the influence of training examples to specific image patches and text phrases. The authors conduct experiments on Qwen and Gemma across image captioning, chest X-ray understanding, and visual question answering tasks. The results show that MOSAIC produces more localized visual features and clearer cross-modal semantic alignment while largely preserving model performance. Ablation experiments further suggest that features ranked by influence scores have a greater impact on model predictions than those selected based on activation values.
Critical strengths
- This paper extends training-data attribution to fine-grained visual and textual evidence by connecting influential training examples with sparse latent features, image patches, and text phrases. This provides a more detailed view of how training data relates to model predictions.
- The paper provides experiments across different models and tasks. The latent intervention results also show that influence-ranked features have a greater impact on predictions than activation-based baselines, supporting the usefulness of the proposed method.
Critical weaknesses
- The paper lacks direct validation of training-data influence through retraining experiments. While the latent intervention results demonstrate the importance of selected features, they do not necessarily confirm the accuracy of the estimated training-example influence. A small-scale retraining experiment would help strengthen the reliability of the attribution results.
- The analysis of removing visual inputs shows substantial changes in training-example rankings, but the retrieved candidate sets have very little overlap. Although the authors also examine shared candidates, the results vary across different settings. It remains unclear how much of the observed difference comes from candidate retrieval rather than changes in influence scores. A comparison using a fixed candidate set would help clarify this issue.
Questions for authors
- Have the authors considered validating the estimated training-example influence through small-scale retraining experiments? If so, how well do the results agree with the estimated influence scores?
- In Section 4.4, removing the image leads to substantial changes in training-example rankings, while Appendix I.2 shows very little overlap between the retrieved candidate sets. Although the authors analyze shared candidates, would the same ranking changes still be observed if influence scores were recomputed using a fixed candidate set under both conditions?
- In Section 3.1, the influence scores are computed using gradients with respect to the upper VLM parameters, while the models are fine-tuned using LoRA. What motivated this choice? Would computing influence with respect to the LoRA parameters lead to different training-example rankings?
- In Section 3.1, the authors estimate latent contributions using activation-weighted gradients. Do these contributions sum to the estimated influence of the corresponding training example? If not, how large is the difference?
- Appendix D.3 shows that SAE layer placement affects model performance. Does changing the SAE layer also affect the training-example rankings or the identified image patches?
4 comments
Followup on Rebuttal for Reviewer vhkS
We sincerely thank the reviewer for their time and thoughtful feedback. As the discussion period ends today, we would greatly appreciate a response indicating whether our additional experiments and clarifications address the remaining concerns as well as if there is anything remaining that we could clarify. We kindly ask the reviewer to consider updating their rating if there are no remaining concerns.
Thanks to the authors for their detailed response and additional experiments. The new experiments have substantially addressed my previous concerns and strengthened my confidence in the reliability of the proposed method. However, the fine-grained attribution results still exhibit some sensitivity to SAE layer placement and the parameter scope used for influence estimation. Therefore, I retain some reservations about their stability across different settings. Accordingly, I have increased my Soundness score from 2 to 3 while maintaining my overall rating unchanged.
Response to Reviewer vhkS
We thank the reviewer for their thoughtful follow-up and updated assessment. We appreciate their recognition that our additional experiments have substantially addressed the original concerns.
We would like to clarify the remaining concern regarding stability. Sensitivity to SAE layer placement and parameter scope is expected and does not, by itself, indicate unreliable attribution. Different SAE layers encode different representations, and their ability to preserve task-relevant information can vary substantially. In particular, when a different layer yields degraded task performance, changes in attribution rankings are expected rather than necessarily indicative of instability. Similarly, different parameter scopes measure influence through different parameter spaces. Identical rankings across these settings are therefore neither theoretically expected nor necessary for reliability.
Importantly, cross-configuration ranking agreement should not be conflated with attribution reliability. The more meaningful criterion is whether the identified influences predict actual model behavior. Our controlled retraining experiments provide direct evidence: under both parameter scopes, removing influential training examples produces loss changes in the predicted direction, approximately 5–15× larger than random removal. Across SAE layers, layer 15 achieves stronger grounding, necessity, and sufficiency results, providing empirical justification for its selection.
We therefore believe that the observed sensitivity reflects meaningful differences in the underlying representations rather than evidence of unreliable attribution. Our experiments demonstrate that the selected configuration produces behaviorally meaningful attributions, while the variation across configurations is consistent with their distinct representational and parameter scopes.
We hope this clarification addresses the reviewer's remaining reservation and would be grateful if they would reconsider their overall assessment in light of the additional evidence.
Gentle reminder about our response
Dear Reviewer vhkS,
Thank you again for your thoughtful review. As the discussion period closes on November 18 (AoE), we wanted to kindly follow up on our response.
Following your comments, we conducted additional experiments and clarifications on (1) training-example influence, validated through retraining (5.7–15.7× stronger effects than random) and reweighting (ρ=0.77); (2) fixed candidate sets, confirming our attribution findings across six settings; (3) parameter scope, supporting our upper-VLM choice; (4) latent contributions, clarifying their interpretation and validating rankings (ρ=0.84); and (5) SAE layer placement, showing stronger grounding and intervention results at our selected layer.
If our response has addressed your concerns, we would be grateful if you would consider reflecting this in your assessment. If any concern remains, we would be glad to provide further clarification while the discussion is still open.
Best regards,
The Authors