- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
When we observe only a part of an agent's thought process, the final intent is not clear yet. Existing methods may force the model to commit to a single intention, while the trajectory so far might be consistent with more than one. Given this motivation, this paper provides a benchmark for identifying a set of possible intentions rather than a single one after observing a chain of thought.
Based on this motivation, the authors introduce MIRAGE, a benchmark that contains trajectories matched under running them with different intentions, and ShenJi, which uses MIRAGE to identify a set of intentions consistent with the current behaviour pattern rather than a single one.
However, I have some concerns about this paper, which I will describe in more detail below, which makes me believe that it is not ready for acceptance in its current form.
Critical strengths
1- I think that the paper genuinely identifies a weakness in how current intent-recognition systems work. Whenever we have partial observations, they can be consistent with more than one intention so the set-valued output of ShenJi is an interesting extension.
Critical weaknesses
1- The proposed methodology seems heavily dependent on the chosen threshold for distinguishability. The results shown in the paper range from very distinguishable to not distinguishable at all, depending on how the threshold is chosen (strict threshold vs. from held-out data vs. from benchmark data)
2- I think that the formula in Proposition 1 might be wrong. If intentions only begin to differ from a step t_0, my calculations show that the distance exceeds the threshold when , not when as reported in Proposition 1. The explanation for this is that when the previous time points in which there is no distinction between the intentions are present in the average, then they are going to dilute the signal, and there are many easily seen counterexamples for the currently reported formula.
3- Proposition 1 does not necessarily show that the candidate set always becomes smaller. In fact, a new intention can enter the set at a later time and this is not covered by the current formulation.
4- The human annoted results might show that some of the claims are overstated, as it is mentioned that some evaluated examples have only one possible intention, whereas none of the human annotators chose a single intention for any of the examples. This is not necessarily right or wrong, it is just the claiming needs to be adjusted and this mismatch needs to be explained.
5- It seems like ShenJi is behaving poorly when there is one possible intention. This can be seen in Fig. 1 for example, with an accuracy of 0.187.
6- Overall, I cannot see a clear advantage for ShenJi in the reported experiments. For instance, as mentioned by the paper itself, predicting every possible intention in a set will receive a higher Set-F1 score than ShenJi, and at matched coverage, the conformal prediction method produces smaller sets than ShenJi.
Questions for authors
Please refer to all the weaknesses pointed out above and explain/justify/correct them. Thanks a lot!
8 comments
Response to W2: Correction of the Time Bound in Proposition 1
We sincerely thank the reviewer for identifying this important mathematical error. We fully agree with your analysis, particularly your observation that the earlier time steps without distinguishable evidence dilute the accumulated discrepancy. After carefully re-examining the original proof, we confirmed that the reported time bound was incorrect. Your rigorous observation has been invaluable in correcting our theoretical formulation.
We have corrected Proposition 1 and its proof (Page 4, Lines 205–215; Page 20, Lines 1062–1074).
Under the assumption that for all , the prefix-mean discrepancy satisfies
=\frac{1}{t}\sum_{s=1}^{t}d(s) \geq\frac{\delta(t-t_0+1)}{t}.$$ Therefore, the observation distance is guaranteed to exceed the indistinguishability threshold whenever $$t>\frac{\delta(t_0-1)}{\delta-\epsilon_o}.$$ This corrected bound explicitly accounts for the preceding observations that dilute the accumulated evidence, addressing the issue you identified. **We have also revised Proposition 1 from "Monotone contraction" to "Eventual exclusion"**, reflecting the precise guarantee established by the corrected proof. The result provides a sufficient time bound for eventual exclusion under sustained divergence, rather than a guarantee of monotonic contraction. Importantly, this correction does not change the definition of MIRAGE's released exact-signature CES, whose nestedness follows from its construction rather than Proposition 1. Instead, it corrects the theoretical justification and establishes a more rigorous boundary for our claims. We are genuinely grateful for your careful mathematical scrutiny. Your correction has substantially improved the theoretical accuracy and scientific rigor of our work.Response to W3: Correction of the Monotonic Contraction Claim
We sincerely thank the reviewer for identifying this important theoretical flaw. We fully agree that Proposition 1, as originally stated, does not guarantee monotonic contraction of the CES. Your observation that an excluded intent may re-enter the candidate set prompted us to carefully re-examine the underlying assumptions and revise our theoretical claims.
1. Acknowledging the failure of monotonic contraction.
The original argument incorrectly assumed that the prefix mean of nonnegative discrepancies must increase monotonically. This is not generally true.
For example, let the indistinguishability threshold be , with per-step discrepancies , , and . The corresponding prefix means are , , and . An alternative intent excluded at earlier steps therefore becomes compatible again at . This possibility remains even if sustained divergence begins at a later time.
We acknowledge that the original monotonic-contraction conclusion was incorrect.
2. Correcting Proposition 1 (Page 4, Lines 205–215; Page 20, Lines 1062–1069).
We have replaced the original Monotone contraction proposition with Proposition 1 (Eventual exclusion). The revised result establishes that sustained divergence eventually excludes an alternative intent, but does not guarantee that the CES decreases monotonically at every preceding step.
We have explicitly withdrawn the unsupported monotonicity claim and corrected the corresponding proof.
3. Distinguishing theoretical guarantees from construction-specific properties.
Importantly, the nestedness of the released MIRAGE ground-truth CES follows from its exact-signature construction. Once a counterfactual observation prefix diverges from the reference, that difference remains in subsequent prefixes, preventing the excluded intent from re-entering.
This construction-specific property should not be confused with a general monotonicity guarantee for threshold-based CES.
We have also clarified that ShenJi's reported rank-margin decoder does not enforce strict nestedness. The optional no-reentry projection is not applied in our experiments (Page 7, Lines 368–377; Page 10, Lines 511–516).
We are genuinely grateful for the reviewer's rigorous observation. It has helped us correct an important theoretical overstatement and establish a clearer distinction between eventual exclusion, construction-specific nestedness, and empirical prediction-set behavior. These corrections substantially improve the theoretical accuracy and scientific rigor of MIRAGE.
Response to W1: Sensitivity of CES to the Indistinguishability Criterion
We sincerely thank the reviewer for this insightful and important observation. We fully agree that intent identifiability is highly sensitive to the indistinguishability criterion. Your comment has helped us recognize the importance of making this dependence explicit, rather than presenting identifiability as an intrinsic property independent of the observation criterion.
We have clarified this issue in the revised manuscript.
1. Explicitly defining criterion-dependent identifiability (Page 3, Lines 139–150).
We now emphasize that CES is a family indexed by the observation distance and indistinguishability threshold, rather than a unique, criterion-independent ground truth. Different criteria can produce substantially different identifiability boundaries, and their results must therefore be interpreted separately.
2. Quantifying criterion sensitivity (Page 8, Lines 402–416; Appendix C.3, Pages 19–20).
Our analysis shows substantial differences across three settings:
The two calibrated thresholds differ by approximately 1.48-fold. Their respective calibration collections contain 213/72 and 392/144 same-intent/different-intent pairs, with false-merge rates of 45.8% and 95%. These results confirm the reviewer's concern that identifiability conclusions depend strongly on the chosen criterion.
3. Clarifying the role of the released ground truth.
We use the strict exact-signature criterion to define the earliest observable distinguishability boundary. It provides a reproducible reference and a lower bound on ambiguity within the considered criterion family, but should not be interpreted as a universally optimal or practically calibrated threshold. For applications concerned with observational indistinguishability under execution variability, a calibrated criterion is more appropriate.
We fully recognize that selecting and transferring suitable thresholds remains an important research challenge. We intend to investigate more robust calibration procedures across different observation settings and execution conditions.
We are genuinely grateful for this suggestion. It has helped us substantially improve the interpretation of MIRAGE and clarify that the framework's contribution lies in making criterion-dependent identifiability measurable and reproducible, rather than claiming a universally fixed identifiability boundary.