- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a four-stage Bayesian pipeline to study arithmetic representations in LLMs, separating decodability, geometric shape, ownership, and causal use. Experiments on two-digit addition and multiplication across three models show that concepts are often decodable, but their geometric structures are frequently shared with related concepts. The results suggest that probe accuracy alone does not establish how a model performs computation.
Critical strengths
This work provides clear conceptual framework. Separating four distinct claims helps avoid equating successful decoding with causal use, offering a useful perspective for interpreting probe results. The paper combines shape comparison, related-concept removal, and causal interventions across multiple models and tasks, evaluating all four claims on the same analysis units.
Critical weaknesses
- The scope is limited. The experiments cover only two-digit addition and multiplication at the final prompt token. It does not fully explain the computation across token positions or establish generalization to more complex tasks.
- The ownership criterion needs stronger justification. If shape evidence does not increase after removing related concepts, this does not necessarily mean the shape is inherited. The removal may also damage information about the target concept.
- Formatting could improve readability. Example tokens, such as 2 and 1 in lines 73–75, should be formatted distinctly to make them easier to distinguish from the surrounding text.
Questions for authors
Refer to Weakness.
Message to Area Chair and Senior Area Chair (Submission 37194)
Dear Area Chair and Senior Area Chair,
Thank you for handling our submission, and thank you to the three reviewers for their time. All three reviewers agree on the value of our main idea, that probe accuracy alone does not show what a model computes with, and that decodability, shape, ownership, and causal use must be tested separately.
We have posted a full response to each reviewer. While we prepared it, we found that most of the weaknesses and questions are already addressed in the submitted paper. Our responses point to the exact sections, tables, figures, and lines. In short:
We fully respect the review process and the judgement of the reviewers. We would be grateful if you could encourage the reviewers to read our responses before the discussion closes on November 18. If they find that their concerns are resolved, we hope that their final reviews and scores can reflect this. If any point remains open, we will gladly answer it.
Kind regards, The authors of Submission 37194