- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper explores the arithmetic of how the model's hidden states responds when copied and replaced elsewhere.
Using the task of calendar arithmetic, specifically months arithmetic, the paper proposes to explore where the hidden states hold information.
The paper only explores this on Qwen 3B model and uses another model as a contrast analysis.
Critical strengths
The problem setting is interesting.
The authors are building on the paper by Feucht et al. to understand arithmetic and see where these arithmetic lies in the model.
The authors utilize a very non-invasive method to try to show how the model understands these simple arithmetic and how swapping some of these numbers within the model can break or change the outputs.
Critical weaknesses
The writing is a little had to follow.
The paper in general is not organized in a friendly way, also utilizing too many jargon for someone who is not overly familiar in the field, making the paper quite difficult to follow.
For example, in the experiments section, in Pair selection and scores, suddenly the term natural accuracy is used.
I'm assuming the authors are trying to say the accuracy of the model with respect to ground truth.
A lot of the writing seems quite verbal and could use some serious polishing.
The experimental findings that are listed are quite limited.
First and foremost, only 1 model, the Qwen3 8B model is compared while the Llama 3.1 8B is supposed to be contrast analysis.
Does this mean that the authors are only trying to understand Qwen3's performance?
Why can't it be the other way around?
Form my understanding, this work seems to be trying to locate where exactly in the model a certain wording (month or day) is being placed in the model and trying to determine how deep in the model it is.
However, there does not seem to be a clear enough support for what their findings are or what we are trying to do with them.
Also, the dataset used is quite unclear. Was this done on a subset of a dataset?
It seems that it was only done through one dataset.
Questions for authors
As mentioned in the weaknesses, how are we to understand how this type of idea scales across model sizes and different types of models?
What is the purpose of the contrast model and can it be used in reverse?
It would be helpful if different kinds of intervention is tested to see how each one would respond to the model outputs.
This can be insightful in showing how the model performs as well.