- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper provides a thorough circuit analysis before and after finetuning of a vision-language model (VLM). They observe and concur with previous works that task circuits present in the base model, largely persist after finetuning. Since these circuits persist, they further use these to predict cross-task finetuning gains. Lastly, they run a failure analysis on the same to figure out when these predictions succeed or fail. The experiments are run reliably and consistently across model families, scale and seeds. The insights are quite interesting and actionable as well. However, the task selection seems a bit unintuitive with no explanation given regarding the chosen tasks and why the datasets were self-constructed. Moreover, it would be interesting to see how cross-task analysis relates to recent taskonomy works in VLMs which verify cross-task transfer empirically rather than task-relatedness measures, and can provide insights into why certain tasks are beneficial / detrimental for other tasks. Lastly, the writing can be improved by a few changes: highlighting the findings, minor typos (Figure 1; L755), labels unexplained (Figure 2(b)), etc. Given the weaknesses pertaining to reliability on scale and synthetic tasks, are addressed, I'd recommend the paper for acceptance.
Critical strengths
- The insights are actionable and relate well to previous work. Failure analysis (Section 5) is also appreciated and paves the way for future work for choosing training tasks for finetuning.
- The experiments are quite extensive, covering modalities, 2 model families, scale as well as multiple seeds. This is quite useful to validate and confirm findings.
Critical weaknesses
- The task selection seems quite narrow and moreover, no intuition is given why these specific tasks are selected. While synthetic tasks are useful for controlled experiments, it is difficult to gauge how these insights transfer to real-world tasks where different visual capabilities are required (spatial reasoning, scene understanding, etc.)
- The results in Figure 3 are quite heterogeneous, varying across models, tasks and modalities. While the paper addresses this, more explanation regarding these observations would strengthen the paper. Similarly, no discussion is provided for Figure 4 for the observations (e.g., why does the arithmetic training task predict to improve pattern matching). It also remains unclear how reliably XCA can be used to select training tasks for real-world use cases.
- The writing can be improved: main findings can be highlighted more clearly, labels and abbreviations in Figure 2(b) are not sufficiently explained, Figure 1 and line 755 contain typos.
Questions for authors
- Can you provide an intuition of why those specific tasks were selected? Moreover, why were they self-constructed?
- L431 claims that "in larger models from both families, the correlations to circuit localization metrics weaken". Does this suggest that circuit localization becomes a less reliable indicator of XCA's predictiveness at larger model scales, or does XCA's predictive performance itself also weaken with scale?
- Was there any correlation of task difficulty with the observations? In particular, could differences in task difficulty account for the varying observations in Figure 3?