- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates how candidate-quality information evolves across recurrent iterations in looped language models. Using linear probes on frozen Ouro-RLTT hidden states, the authors show that candidate-quality information becomes increasingly readable across loops, with early physical layers achieving performance comparable to late-layer baselines by loops 3–4. They further find that probes trained on the first loop transfer poorly to later loops, whereas probes trained from loop 2 onward remain effective, suggesting an initial change followed by stable readout directions. These findings are validated across multiple Ouro checkpoints, with partial replication on Huginn and a non-looped Transformer control.
Critical strengths
The distinction between local probe readability and frozen cross-loop transfer is a potentially interesting approach to studying representation dynamics in looped transformers. However, I do not find this contribution sufficiently novel or substantial to outweigh the concerns below.
Critical weaknesses
-
This paper is completely an AI slop in my opinion
- The paper is pretty hard to read, starting from the first sentence in the abstract (
so “physical layer 8” is not one event but one per pass). While reading the abstract, I have no idea what "physical layer 8" is. - There are so many clear AI generated signals without any human intervention. E.g., unreadable draft and "SHA256SUMS" everywhere in the appendix.
- The paper is pretty hard to read, starting from the first sentence in the abstract (
-
After I dig into some related works, I noticed that a large part of this paper is exactly the same as a paper cited by the author (arXiv preprint 2607.18553), and surprisingly they cited it ~10 times all through the paper. More specifically, the Figure 1 in this paper is the same as Figure 2 in this arXiv paper. Much of the data matches the arXiv preprint. The author even mentioned in Line 450 that
The taps, CoreContent target, late-layer basis, and correction history come from a broader programme on frozen Ouro-RLTT (Kirin, 2026a;b). So it either violates double-blind (if the authors are the same, which is highly likely) or plagiarism. Therefore, I recommend that this submission be desk-rejected.
Questions for authors
See Weaknesses