- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies whether numerical information represented inside a language model actually influences its rule-following decisions. In a controlled bank-reporting task, the correct verdict depends on both how a transaction is split and how its amounts compare with a stated reporting threshold. Across four instruction-tuned models, the authors find that threshold-dependent information reaches the decision position, while the examined decision-related components respond strongly to splitting and weakly to threshold changes. In Llama, they further identify a representation predictive of the amount–threshold relation: interventions that move its decoded value across the threshold change the verdict by only 2.0–2.3% of the effect of their permit/prohibit control. Behaviorally, supplying the correct numerical comparison often fails to repair errors, whereas supplying the resulting non-evasion judgment is much more effective. A simpler drone-altitude task shows that numerical thresholds can strongly influence decisions when a single comparison determines the answer.
Critical strengths
They test multiple layers, expand interventions beyond one direction, include verdict-matched contrasts, and replicate several findings across four models. They also report inconclusive experiments and differences between models.
Critical weaknesses
The test set is too narrow to establish a reliable conclusion and to support the work's broad claim. The authors could test more popular public datasets.
The writing, especially the introduction, is hard to follow due to many unclear terms, making it hard to understand the research question.
The threshold and amount remain at their own token positions, and later heads at the last token can re-read them. It means the patch isn’t a clean test of “the decision doesn’t read T.”
Questions for authors
How do your research question and observations generalize to more common cases?
Response to XmNU
Thank you for distinguishing model-family replication from task generalization and for identifying the alternative-pathway problem.
Generalization. We completed a 512-prompt Llama screen that matches numerical values and qualitative facts across comparison-only and combined rules, neutral and fictional banking contexts, two phrasings, and both YES/NO mappings. With YES meaning FLAGGED, accuracy is 116/128 for comparison and 128/128 for the combined rule. Reversing the mapping yields 61/128 and 63/128. None of the prespecified strata establishes a reliable composition-specific failure. These results do not support generalizing the original banking failure to numerical/qualitative rule combination broadly. The fictional banking policy is simpler than the original regulatory task; it is a controlled comparison, not a public-dataset replication.
We have not added a public benchmark and will not claim coverage beyond the tested settings. Four model families provide replication within the historical prompts, whereas the new screen is Llama-only. Surface-identity repetitions also do not create independent transaction types: the original verdict-matched cohort contains three transaction types repeated over eight identities.
Alternative pathways and intervention validity. We agree that patching the final prompt-position residual leaves other positions and coordinates available for subsequent computation. A small effect from that patch cannot establish that the model never reads the threshold. Moreover, our new identity-controlled representation test retains decodable sign information but does not validate the proposed numerical intervention direction. We will withdraw the inference that this intervention demonstrates an independently computed comparison failing to affect the verdict.
The narrower component result remains: under the tested donor-output swaps, selected polarity-aligned components respond much more along the measured readout to action edits than to threshold edits. This is a statement about particular interventions, components and a readout—not exclusion of other routes or a claim that the readout captures all numerical influence. Final verdict effects were not measured in that component experiment and will not be implied.
We will simplify the introduction and state the behavioral task, intervention site, measured outcome and inference limits before presenting results. The title and conclusions will be narrowed accordingly. The follow-ups clarify the boundary of the finding, rather than establish the broader interpretation in the submitted headline.