- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a protocol for evaluating how scientific agents reach their conclusions rather than only checking final answers. It uses controlled disclosure of cancer identities, planted false identities, and LLM judges to evaluate evidence provenance, support, and premise testing. The authors evaluate four agent models on 760 episodes across seven TCGA cancer cohorts. The results show that agents often recognize cancer identities from prior knowledge or available clues. Three models frequently adopt the planted false identity, while Opus 5 is more resistant. The paper also compares agents with a scripted k-means baseline and analyzes several evaluation artifacts.
Critical strengths
-
Generally speaking, the paper is trying to address a meaningfull and important question in the agent scientific evaluation. It is true that the correct answer does not always mean an agent discovered it from the data. Also, the paper's method separates outcome quality from evidence provenance. Additionally, it test how agents with the false information.
-
By and large, the experiment is comprehensive. This paper's evaluation consists of judge sensitivity analysis and comparisons across four models. Also itself identify several problems in the evaluation, I appreciate that the negative results are reported.
Critical weaknesses
Concerns about the process evaluation reliability:The reliability of the process evaluation remains questionable. LLM judges show large differences in D2 explore counts (ranging from 102 to 401) and fail to reach a majority consensus in 153 out of 760 episodes. Additionally, neither provenance instrument has undergone human validation. A 20-trace human audit shows low agreement with the LLM judges on whether a label was tested (κ = 0.41 and 0.10), and the underlying model of one judge, laguna, remains undisclosed.
Confounded Evidence-Based Resistance: It is difficult to isolate evidence-based resistance. While Opus 5 avoids the false identity in a portion of G3 episodes, it also identifies cancers early in G2 before gene-symbol release, making it unclear whether its robust performance relies on active evidence checking or simply prior knowledge. Furthermore, experimental inconsistencies—such as G0 providing the true identity upfront versus G3 introducing a false identity later, alongside varying prompt structures—weaken the control of the procedure comparison.
Questions for authors
-
Could you provide the human validation of the provenance labels and tell me about the model of laguna?
-
I wonder for opus 5, will it still be resistent to the false labels when it has not identified the correct cancer before? To what extent do the different disclosure timelines between G0 and G3 impact this conclusion?
Post-rebuttal update: lowered from 3 to 2, see comment
3 comments
Response to rebuttal
The new experiments address part of the issues. However, some new concerns arise and I decide to lower the rating from 3 to 2.
-
Human validation shows the core provenance instrument is not reliable: When κ = 0.08 and 0.04, Annotators agree with the panel’s D2 strategy label. Annotators then set the 7% and 40%. This is aganist the 46% of the panel.
-
author only copy the number that looks closest to the final answer. They agree on the winner. But they do not agree on whether the test actually happened (κ 0.10–0.61). And the numbers swing wildly depending on the judge (+8.3 to +71.4 pt). So it seems that there's barely any proof for how the scoring works.
3.Question 2 has not been completely solved yet. Opus 5 could still recognizs the dataset when the label is revealed. for the 11/16 start-label rejections. we couldn't know whether the Opus 5 name the true cancer after the symbol is released or not.
Therefore, the paper is moe like a case study not a validated evaluation protocol
We thank the reviewer for the careful follow-up.
We agree that the provenance labels are not reproduced by humans, and we present the explore rates as exploratory. The disagreement is largely explained by the judges: they tend to accept the agent's own account of how it reached the identity (e.g., "inferred from KLK3/KLK2") even when the trace shows the cancer was named before any gene name was visible. In the premise test, where the judge is told when the label arrived, agreement is high. In future work we will give the judges the harness's event timing and replace the panel with human annotation where it disagrees substantially with humans. In the present paper, the supported claims rest on the interventions (withholding the identity, planting a false label, exposure-conditioned denominators), not on trace labels.
On point 2: we agree that which side prevailed is read from the final identity, and that the judges' readings of the trace are weakly validated. However, the "how" comes mainly from the interventions rather than from these judge readings. On its own, a final identity does not show how it was reached. When we control what the agent is told, it does: an agent that ends on the true cancer after being given a false one did not take its answer from the label. No model rejects a true label (Appendix A.13, Table 13), so a rejection is not a habit of contradicting the harness. With a false label given before any data, Opus 5 rejects it in 11/16 episodes and Sonnet 5 in 0/16 (Fisher ). The two models receive the same input; Sonnet 5 takes the label, and Opus 5 ends on the true cancer citing markers it has computed (see Q2). Opus 5's answer therefore came from its own evidence, not from the label, and this needs no judge (see also Section 5, lines 465-466). Identity provenance at G2 also needs no judge, since it is read from the harness timestamps: 100 of 168 withheld identities are named only after the gene symbols are released (Section 4.1, line 309), so withholding the identity did not make most agents derive it; and Opus 5 names a cancer before any gene name is visible in 24 of 42 episodes (Appendix A.14, Table 15, line 1306). The outcome score cannot separate these routes: within each model it is the same across them, and its gate fires in 5 of 168 G2 episodes (Section 4.1, lines 319-322). The low human agreement in A.12 does not affect these readings.
On Q2: all cells of the are scored by the same judge; on five Opus 5 start-label episodes the opening instruction omits "show your reasoning", and every reading holds without them (Appendix A.13, lines 1250-1254). The matched contrast is 11/16 rejections with the label at the start versus 7/16 at the third observation (Fisher ), not significant and opposite to what prior identification predicts: by the third observation Opus 5 has usually named the cancer first (Table 14), yet it rejects less. In 10 of the 11 start-label rejections, Opus 5 first names the true cancer only after the gene symbols are released, in 9 while citing lineage markers it has just computed (e.g., TP63/SOX2/KRT5 high and NKX2-1/NAPSA low for LUSC; PAX8/WT1/MUC16 high for OV). None of the 5 adopting episodes names the true cancer. The shape cues (sample count, deaths, age, stage) are the same in all eight episodes of a cohort, yet with 11 rejections over two cohorts of eight, at least one cohort gives both outcomes. The rejections therefore follow marker evidence rather than shape cues, although a regex over the reasoning text cannot fully separate derivation from recognition (Section 5, lines 463–465; Appendix A.13, lines 1274-1275). The final identity and the naming time are read from the submission and the timestamps, not from the judge.
We accept that the findings are a case study of one task. On this task, the parts of the protocol that read the log without a judge are validated; the judges' trace labels are not. We found their error by checking them against the harness timing, which is the point of Appendix A.21 (line 1611, "Instruments require known-value arms").
We thank the reviewer. All changes in the revised PDF are marked in blue.
Q1. Human validation of the provenance labels, and the laguna model.
Two new annotators reviewed 32 traces for identity provenance (Appendix A.12). Against the panel, they agreed on the D2 strategy in 12/25 and 12/26 traces (κ=0.08 and 0.04). They confirmed the panel's exploit calls (11/11, 9/12) but rarely its explore calls (1/10, 3/10). Both put G0 exploration at 0%; for G2 they gave 7% and 40%, against the panel's 46%. We now treat these labels as exploratory and have narrowed the claims that rely on them (Section 4.1, Appendix A.9 and Limitations). Analytic provenance remains unaudited by humans.
For premise handling (Appendix A.11), the two new annotators agreed with the panel on which side prevailed, the supplied label or the agent's own evidence, in 19/20 and 18/19 assessable cases, and on whether the agent tested the label in 17/20 and 17/19.
The "laguna" judge is Poolside's Laguna S 2.1 (model card), served through our institutional gateway; the paper now names it in Section 3 and Appendix A.8. We chose the three judges (nemotron-3-super, Laguna S 2.1, Qwen3.6-27B) for diversity: they come from three different developers, none belongs to an evaluated agent family, so no model grades its own, and each has a context window long enough to read a full episode trace.
Q2. Does Opus 5 resist the false label when it has not identified the cancer first, and how does disclosure timing affect this?
We added experiments to address this (Appendix A.13). We ran a 2×2 design crossing label truth with label timing. Every cell delivers the label through the same channel, with 16 episodes per cell and per model.
Yes, Opus 5 resists without a prior identification. With the false label given before any data, it rejects the label in 11/16 episodes. Neither model rejects a true label at either timing, and Sonnet 5 adopts the false label at both timings. (The false-label cell at the third observation is the 16 lean G3a episodes, re-scored.)
Across the original G3 episodes, we split Opus 5 by whether it had named the true cancer before the label:
Resistance is similar either way (p=0.70). Sonnet 5 rejected 0/29 without a prior identification and 0/13 with one. A prior identification is neither necessary nor sufficient for resistance.
On timing, the original G3 already varies when the label arrives (third vs fifth observation; later reveals would leave the agent nothing to do before the label). With the new start cell this gives three timings:
The later the false label arrives, the more often Opus 5 has already identified the true cancer: 0%, 75%, 100%. Its rejection of the false label stays at 66–69% (p=0.97), whereas the prior-identification account predicts it would rise. We detect no timing effect, though the cells are small (16–32 episodes) and cannot exclude one. Sonnet 5 adopts the false label at every timing.
New episodes were scored by a single LLM judge (Qwen3.8-Flash), because the original panel endpoints were retired. On the 32 episodes scored both ways, it agrees with the paper's panel on 30. The G3 splits above use the paper's panel. The design and decision rules were fixed before the runs.