- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies how prompting and post-training change hidden-state geometry using divergence, curvature, and two learned readouts associated with reasoning and judgment. It reports relative behavioral separation, shared frame reorientation across checkpoints, and a separate reflection-success prediction result.
Critical strengths
-
Alignment-aware analysis. Held-out Procrustes alignment removes most of the apparent difference between the two factors’ rotation angles. This provides a useful caution against interpreting raw representational rotation as function-specific change.
-
Behavioral validation. The authors evaluate the readouts using independent reasoning-demand and judgment-policy contrasts, alternative probes, and additional tasks. The intervention controls also appropriately distinguish behavioral readability from selective steerability.
Critical weaknesses
- Unclear functional interpretation. The learned readouts show different sensitivities to reasoning-demand and judgment-policy changes, but their functional labels are unstable across probes and tasks. The evidence supports a relative response difference more clearly than a reproducible characterization of reasoning and judgment.
- Limited explanatory contribution. Suffix invariance follows directly from causal masking, while curvature effects depend on the measured span and metric. The interpretation that prompting changes functional engagement therefore relies heavily on readout comparisons that are themselves sensitive to probe choice and depth.
- Disconnected monitoring result. Reflection-success prediction uses raw hidden-state distances rather than the learned readouts, leaving the practical value of the proposed functional organization unestablished. The different instructions and contexts across reflection passes also warrant matched controls to clarify what the predictor captures.
Questions for authors
What is the benefit of learning these two readouts? The reflection predictor does not use them, and steering along them performs no better than random directions. What do they help us understand or accomplish beyond analyzing the original hidden states?