- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors aim to better understand model behaviour in clinical scenarios where patients ask for health-related assessments and recommendations. Specifically, they investigate how the model's default behaviour is influenced by patient preferences. They first approach this from a mechanistic perspective, using causal interventions to identify which layers are responsible for these behavioural changes. They then fine-tune the model to improve its performance on this task, aiming to reduce discrepancies in its behaviour. Finally, they investigate whether the changes in latent representations induced by fine-tuning can be transferred back to the base model.
Critical strengths
-
The problem addressed is an interesting and relevant issue with LLMs, and it is well motivated through a clear, real-world example.
-
The paper follows a nice structure, starting with experiments aimed at identifying and better understanding the issue, before moving on to explore a potential solution.
-
The experimental setup is ok and investigates the problem from different perspectives. The authors first examine the model's internal mechanisms through several analyses using causal interventions and then fine-tune the model to improve its performance on the task. I also appreciated the analysis of how transferable the latent representations produced by the fine-tuned model are to the base model.
Critical weaknesses
-
Although the overall structure is reasonable, the paper is not always easy to follow. The writing is dense and sometimes fragmented. Moreover, since the paper moves directly into experiments and results, it would benefit from a higher-level overview of the hypothesis and rationale behind each experiment. This is especially noticeable in Section 3, where the authors immediately describe what they did and the results they obtained, without spending enough time explaining the experimental setup (e.g., at which tokens the activations are injected?), stating the hypotheses, and clarifying the expected outcomes. As a result, some sections feel more like a report of experimental results than a research paper.
-
The experimental setup is generally reasonable, but I would like to see whether the findings generalise to at least one additional model for Section 3 results (causal interventions), preferably from a different model family.
-
Is there a drawback to choosing the same layer for both tasks? Looking at Figure 2a, later layers also seem to have a stronger impact.
-
I think my main concern is how the experimental setup and results are presented. The presentation feels somewhat disorganised, making it difficult to identify the main findings of each section on a first reading. More effort should be put into highlighting the key outcomes and guiding the reader through the hypothesis behind each experiment, its main findings, and why these findings are (or are not) aligned with the initial expectations.
-
Figure 1 must be redrawn, fixing the visible AI-generated artifacts.
Questions for authors
See above