- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposed Belief-Trajectory Energy(BTE)that projects logis into predictive distribution and then calculate the SJD between layers
Critical strengths
1 The method is simple, requiring only a single forward pass and no training, and is applicable to any open-source model. 2 The experiments cover a wide range of areas—difficulty, detection, attribution, and training dynamics—and have been repeatedly validated across multiple scorers. 3 There are numerous controlled experiments, including length residualization, writer control, splitting the training and test sets by paper, transfer across generator families, and human rewriting. 4 The authors candidly report the limitations, including length heterogeneity, scorer dependency, and failed transfer to new generators.
Critical weaknesses
1BTE is essentially logit lens plus layer-wise JSD, so novelty is limited. 2The difficulty signal is largely explained by response length. 3Cross-task ordering reverses for three scorers, contradicting the authors’ explanation. 4Baselines are zero-shot while BTE is supervised, and some are sign-flipped. 5GPT-5.5-rewritten human reviews are still labeled human, suggesting format cues. 6The Ethics statement and Appendix A.4 contradict each other on who did the human evaluation. 7Training analysis is weak, with a non-significant final OLMo ρ and a single seed. 8 The 95.6% accuracy excludes the human class, and attribution is closed-set with no stylometric baselines.
Questions for authors
1 How does BTE compare with simple baselines such as final-layer NLL, entropy, and response length for difficulty?
2 Why was the middle-layer window chosen, and do results hold under a pre-registered or tuned-lens readout?
3 Why does weak Mistral also reverse the cross-task ordering if the cause is math training exposure?
4 How does BTE compare with supervised baselines trained on the same data, such as per-layer NLL or a fine-tuned RoBERTa detector?
5 Why are GPT-5.5-rewritten human reviews still classified as human, and does the detector rely on review format?
6 Was the human evaluation done by the authors or by six recruited evaluators?
7 Do the fine-tuning results hold across multiple seeds with confidence intervals?