In the introduction, lines 48-50, cite the claims you are raising; you are saying prior works … but there is no citation for them.
Again, in the introduction before the third paragraph, you just jump into what you are doing and do not specify any gap, just talk about prior works and then move to your work.
The claim in lines 63-64 is not correct because if you change your benchmark category to something else, like commonsense, code, … you need to refit it. You are only working on the mathematics benchmark category.
In Section 2, they did not clearly separate methods that predict before generation from those that check after.
In lines 76-78, there are a lot more papers that you need to cite in your related work, like [2, 3].
In lines 88-90, you are drawing on your novelty, which is not the case; there are lots of papers that extract activation at a specific layer and then apply it on the same layer, like [1, 4]. You need to cite [4]; it is relevant to your work.
In line 92, there is also another closely related work that is [1].
In line 107, you should also cite [4].
In lines 117- 118, you did not cite [5], and this already investigates using representation directions for both detecting and controlling model properties, so the claim that previous approaches use these directions mainly for control might be too broad.
In Section 3.3, the layer is picked using just a simple problem like adding two numbers, but some of the GSM8K problems need reasoning steps.
In Section 3.3, patching shows that a layer affects answer probability, but this does not by itself show where arithmetic is computed. The selected layers are close to the output, where changes can affect answer scores.
Some of the numbers don’t add up. In Section 3.1, they say they collected 160 incorrect Qwen responses and 160 correct ones, but then report 480 examples. That should be 320.
In Table 2, the Qwen linear probe gets 0.751 AUC, but Section 5 uses 0.738 and says the probe was evaluated on a different split. That makes it hard to compare them.
The experiments just report AUC. Qwen gets around 96% of GSM8K right, so even with 0.783 AUC, it can’t tell how many wrong answers will get caught or how many right ones will get stopped for no reason.
The abstract reports 0.627 and 0.786 for Mistral and Qwen, which are the average projection results, while the single-layer numbers are 0.621 and 0.783. Since the paper focuses on the single layer, this should be clearer.
As mentioned in lines 401-404, correctness information in hidden states, linear probes, and difference-of-means directions is done in previous works. So show what this combination adds, something like better prediction or a new finding about reasoning, to have more contribution besides simplicity and negligible cost, that is mentioned in lines 406-407.
On a small note, please cite the models in line 137.
[1] Orgad, Hadas, et al. "Llms know more than they show: On the intrinsic representation of llm hallucinations." International Conference on Learning Representations. Vol. 2025. 2025.
[2] Ji, Ziwei, et al. "LLM internal states reveal hallucination risk faced with a query." Proceedings of the 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP. 2024.
[3] Sun, Yucheng, Alessandro Stolfo, and Mrinmaya Sachan. "Probing for arithmetic errors in language models." Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
[4] Sun, Yucheng, Alessandro Stolfo, and Mrinmaya Sachan. "Probing for arithmetic errors in language models." Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
[5] Zou, Andy, et al. "Representation engineering: A top-down approach to ai transparency." arXiv preprint arXiv:2310.01405 (2023).
Response to Reviewers (Part 1/2): Layer-Selection Control
Part (1/2) We thank all the reviewers for their detailed feedback, which significantly helps in improving the paper. The comments can be broadly divided into three categories: (i) Whether the patching-based layer selection adds anything over simpler layer-selection strategies? (ii) How useful the readout is at a fixed operating threshold rather than just in terms of AUC? (iii) A few inconsistencies in reported numbers. We conducted two additional experiments to address the first two, and address the third in the final section. All tables referenced below (Tables A1, A2 and B1) are in the Appendix of the revised paper, and Table 2 refers to the main results table of the paper.
**Layer selection control ** The primary aim of the study is to investigate whether the causally implicated layer also encodes the signal of the models’ eventual correctness. The aim of the paper is not to test whether the causally implicated layer is the optimal choice. Instead of searching for the best layer for each model, the paper asks whether we can use the signal available at the candidate layer to predict the model’s eventual correctness. To check how the causally identified layer compares with other choices, we employ a controlled comparison using the same data, splits, and difference-of-means measure, varying only the layer used for the readout. We compared the candidate layer against the final layer; layers at 50%, 75%, and 90% network depth; the best layer selected through 5-fold CV on the calibration set; and 1000 random averages of 5 layers. We use paired bootstrap with 10,000 resamples for the comparisons.
We find that in four of the nine comparisons the difference is statistically significant and and alternative layer has an AUC greater than patched layer-based AUC; while other five cases are statistically insignificant (Table A1). However, no fixed layer-selection rule works consistently across models and datasets. The layer selected through cross-validation varies by model: the best CV layer for Mistral is at around 50% depth, whereas for Qwen it is at around 75% depth. Similarly, the 50% depth layer performs almost identically to the patching layer for Mistral, is slightly better on Qwen GSM8K but much worse on Qwen Socratic (−0.087) and SVAMP (−0.046) and is consistently better for Llama (Table A2). A fixed relative-depth rule therefore does not transfer reliably across models and datasets, whereas patching gives a model-specific way of selecting the layer. The aim of the paper is to test whether a layer that is causally important for the task at hand (in the paper’s context, the mathematical problems) has a signal that can predict eventual correctness. We sincerely thank the reviewers for suggesting that we test whether the candidate layer is the optimal layer and the identified dissociation between causal localisation and linear decodability (in terms of the optimal layer) through the suggested experiment is interesting in its own right. In future work, we aim to test whether the causally identified layer plays a causal role in models’ correctness, compared with the best-performing layer (in certain cases). This would show whether the causally identified layer matters more for getting the answer right, even if the best-performing layer predicts better (in cases where it does). One difference to note is that the new Qwen experiments use a natural-rate sample of 1000 randomly selected problems (700/300 split), rather than the error-enriched sample of 480 used in Table 2 of the paper. We made this change to evaluate operating-point performance at the model’s actual error rate, since metrics such as precision, recall, and false-positive rate depend on the proportion of incorrect answers in the sample. The enriched sample (160 incorrect and 320 correct) was suitable for the original AUC and top-k experiments but does not reflect the model’s natural error distribution (approximately 4–5% errors; Table A1).
For Mistral, the candidate layer (L29) is essentially tied with the other layer-selection rules (Table A1 and ). The only clear exception is the final layer, which performs worse on SVAMP (-0.027, p=0.025; Table B1). For Llama, the candidate layer outperforms the final layer across all three datasets, but the 50% depth layer outperforms the candidate layer (+0.031 to +0.054; Table A2). For Qwen, the 75% depth layer performs better on GSM8K (+0.048, p=0.003; Table A1), while the other comparisons are largely tied. Overall, patching identifies a layer that is sufficient for the readout, rather than necessarily the optimal layer.