- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper develops a geometric view of competing-evidence attention by defining a switching wall between two evidence branches, derives an exact decomposition of attention-output responses into branch-switching and outside-mass components and shows that baseline local information can predict finite intervention effects. The proposed switching-normal directions are behaviorally relevant and task-enriched, but the experiments do not establish a consistent advantage over strong static steering baselines.
Critical strengths
The idea sounds interesting.
Critical weaknesses
The manuscript is heavily over-engineered and difficult to read. It contains extensive internal filenames, code paths, hashes, audit records and implementation history, which makes it a strong AI-assisted log rather than a polished paper. The abstract is not polished at all, including ???. The paper also accumulates many experiments, reruns, controls and post-hoc analyses without clearly identifying which results are central. Some experimental evidence is explicitly unresolved or invalidated by the authors' own audits. At current status, I would not like to call it a paper.
Questions for authors
See weaknesses
Thank you for your careful review and constructive comments.
Internal material. Filenames, paths, hashes, and audit records were removed; the revision is 10 main/13 total pages, with only proofs, protocol, criterion, and a per-head table in appendices.
Abstract/“???”. Rewritten without unresolved references or macros, it states one claim, result, and caveat.
Central result. One native-path experiment reports pre-specified R−L differences of −0.0177 [−0.0219,−0.0136] and −0.0248 [−0.0293,−0.0206] nats/token (Section 4.2; Table 2); secondary and unreported planned analyses are identified (Sections 4.3–4.5; Limitations).
Invalid evidence. All custom-path experiments and steering are withdrawn; both models fail the pre-specified all-width fp32 criterion, while weaker best-width and post hoc float64 checks pass but do not replace failure, so results remain descriptive (Sections 4.1, 4.5; Tables 1, 5).
Steering. No advantage over static baselines is shown; we make no steering/control claim (Limitations).
Remaining limits. Two models, one dataset, eight pre-selected heads/model, AtP* overlap, unsupported Eq. 11, and unchanged title are stated; no human line-by-line read has occurred.