- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates whether distinct mental-accounting biases in LLMs share an internally manipulable component. It constructs contrastive activation directions from mental-accounting and fungibility persona prompts, and studies behavioral dose responses, cross-dimension transfer, geometric alignment, and several control interventions. Across six models, the paper finds strong alignment between segregating-gains and integrating-losses directions; sunk cost is connected primarily through functional transfer rather than vector collinearity. The most extensive intervention evidence is obtained on LLaMA-3-70B. These results support a shared functional steering component, while leaving open whether the biases arise from a single underlying mechanism.
Critical strengths
-
The paper moves beyond reproducing behavioral biases to testing whether they can be jointly manipulated through internal interventions. Cross-dimension transfer provides meaningful evidence for shared functional structure.
-
The controls are substantive: norm-matched random directions, adjustment for a generic instruction-following direction, and persona-related analyses address several straightforward alternative explanations. The distinction between collinearity and functional transfer is also valuable.
Critical weaknesses
-
There is an unresolved mismatch between the range used for the central transfer statistics and the range supported by capability-preservation tests. Appendix B.3 describes a sweep through |α|=0.40 and reports 13 significant arms out of 15 assessable arms. Appendix C.5 states that main analyses are capped at |α|≤0.30 because stronger negative interventions substantially degrade general-knowledge performance. It is unclear whether the 13/15 result survives the restricted range. Since the capability test applies edits at every decoding step, I do not assume that its degradation directly transfers to every main experiment; the intervention protocol and statistical range need to be reconciled.
-
The strongest transfer evidence is concentrated in one model and a small prompt panel. Repeated generations support effects conditional on these prompts, but broader scenario-level generalization is less well established. The structurally different prompt tests are useful, although their support is uneven across dimensions.
Questions for authors
- Please report the complete cross-dimension transfer matrix, effect sizes, and multiplicity-corrected significance using only |α|≤0.30. Does the 13/15 conclusion remain valid? Please also reconcile the intervention positions and application frequency used in B.3 and C.5. A robust result under the capability-preserving configuration would materially improve my assessment.
- Which transfer effects remain consistent when reported separately by prompt, or when uncertainty is computed with prompts as clusters? This would clarify whether the shared component generalizes beyond the particular sampled prompt panel.