- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors study pre-generation prediction of the first violation of an explicit instruction in a multiturn conversation, conditional on the previous reponses remaining compliant. The main question that the paper looks at is whether the predictive performance remains reliable when the probing pipeline is reconstructed using different developmental partitions. The task uses first-event labels where compliant turns contribute negatives and the first violation is a positive, and subsequent turns are omitted. The main method proposed in the paper is frequency-consensus which fits logistic probes to individual attention head outputs at the final context token. Experiments are on scripted english dialogues per model-constraint configuration with up to 14 turns covering seven deterministically verifiable constraing families. The paper reports increased aggregated construction variability in matched single-turn vs multi-turn comparisons and against all-heads a 1.9 pp inmprovement.
Critical strengths
- The authors provide a useful distinction between predictive accuract and construction reliability.
- The table 2 results are interesting, and the authors compare with broad baselines in Table 3 and show that their method improves over the baselines.
- The authors describe the representation extracting before any token of the predicted response is generated, and excludes test observations from standardization, head selection and hyperparam selection, so there is no scope for potential leakage
Critical weaknesses
- The main improvemenets that the authors present are All-heads, and from Table 2 relative to Mean-AP, frequency-consensus reduces the AP SD by only 0.06 points on Gemma, 0.17 on llama and 0.06 on qwen, these improvements are very modest.
- In section 4.2 the authors discuss contributors to instability but the experiments do not isolate these. Such as expanding the training window, changing sample counts, class weighting and temporal coverage. ALso the 20 constructions re-partition one fixed development pool whereas the dialogue scripts, generated response labels and test set remain fixed, so the stability claim is limited in scope.
- The main comparisons report model level averages without per-constraint results or turn wise results, so it is hard to determine whether frequency-consensus helps broadly, or benefits late or rare events or only particular tasks.
Questions for authors
See weaknesses section above