- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the possibility to use native routing signals from pre-trained Mixture-of-Experts LLMs to detect machine-generated text. The core idea is that, despite not being trained for this kind of task, they inherently retain signals involving authorship-related information, and these can be extracted and fed into a linear classifier to perform detection. To this aim, the authors use GPT-OSS-20B as a routing model and, based on 500 human-AI pairs, they train a small linear classifier. The experimental setup based on the MIRAGE dataset shows high AUROC values, which outperform the considered baselines.
Critical strengths
- The idea is interesting and involves a rather underexplored connection between MoE inner workings and detectability signals. This is also valuable due to the fact such models have not been instructed to perform detection, and the proposed method simply exploits representations learned for language modeling.
- The overall architecture depends only on a frozen MoE model and a simple readout module, trained on just 500 training pairs.
- The ablation of routing representations provides valuable insights into the inner workings of such a detection signal, and the fact the latter generalizes properly across MoE model implementations corroborates it.
Critical weaknesses
- First, the proposed approach is evaluated on a single benchmark (MIRAGE). This limits the strengths of the claims about the proposed approach, and demands further evaluations on widely used approaches (e.g., RAID, OpenTuringBench, DetectRL). Furthermore, the human-edited AI text might also introduce some stylistic artifacts that trained readout could exploit rather than leverage proper authorship signal. Therefore, external benchmarks might strengthen generalizability and exclude any kind of leakage.
- While the reported AUROC is high overall, this might hide some practical constraints for real-life deployment. For example, as suggested by Table 2, TRP at 1% FPR is rather low, which means leaving a non-negligible set of AI-generated text undetected. Similar patterns hold in Table 4, where Prob [email protected] for DeepSeek is remarkably low despite the high AUC. Furthermore, Figure 3(a) suggests a strong performance imbalance based on the prefix length. Taken together, such results suggest that strong ranking performance does not reflect onto detection effectiveness, and matter a lot for real deployment of the proposed approach.
- Last but not least, this approach requires accessing MoE models’ internals, and such models are typically larger in size (with some exceptions e.g., OLMoE) than smaller proxy models used by current detectors (e.g., RoBERTa-based or < 7-8B decoders). Hence, the small cost of the projection module has to balance the high cost of serving such models to extract the signal.
Questions for authors
- Can you evaluate the proposed approach on additional benchmarks like RAID, OpenTuringBench, and DetectRL (as they also cover attacks and out-of-domain data)? This is particularly important and I'll be happy to revise my score accordingly.
- Can you better shed light on the imbalance between AUROC and operating point performance? This would matter a lot too for deployment.
- Across the paper, authorship identity and information are widely used concepts. However, this might wrongly overlap with the idea of Model Authorship Attribution, i.e. identifying the specific generator that produced a given text to be detected. Please clarify accordingly.
- How are the “operating-point” parameters calibrated for real-life deployment considering the reported TPR @ 0.1 FPR?
Thank you for your constructive feedback.
Comparison of Native Routing with PCA and Random Projections (W3, Q1) Our goal is to analyze how much authorship information a pretrained MoE router preserves from hidden states (§1, L068–084; §3.1, L165–194), rather than to outperform all dense activation probes. Projecting hidden states into a compact expert space (Eq. 1, Thm. 3.1) incurs information loss; comparing routing with PCA and hidden-state probes (§4.2, L452–458; App. D) quantifies what survives in this fixed pretraining subspace. Unlike PCA (which stores full dmodel activations to fit a task-specific projection) and random projections (which sample random directions and train task-specific classifier weights), router scores are task-agnostic signals produced during standard inference. Moreover, discrete top-K expert counts—a non-linear, piecewise-constant operation irreducible to a linear probe on mean hidden states—match continuous scores (§3.2, L211–215; Table 2), showing that expert allocation encodes text provenance.
Empirical Analysis of How Routing Captures Authorship Signals (W1, Q2) Controlled probes and ablations (§3.3, L216–297; §4.2, L365–451, Tables 2–3, Figs. 2–4) clarify how routing captures authorship:
Evaluation on Independent Datasets Beyond MIRAGE (W2, Q3) We evaluated the frozen GPT-OSS-20B observer (24×32=768 router logits, 769-parameter linear head) on RAID and DetectRL, training on 500 clean human–AI pairs (3 seeds) and testing on source-disjoint splits:
Nine of RAID's 11 attacks maintain strong readability (except homoglyph and zero-width-space spoofing), confirming generalization beyond MIRAGE. Comparison with RAID baselines (Tables 15–16) and official repository records:
“—”: unavailable; *missed target FPR; †source-disjoint public holdout using RAID per-domain thresholding and official pooling weights.