- Rating
- 1(−1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates a fundamental question: when a scientific agent’s verifier deems a conclusion verified, what is it actually checking—numerical consistency, the alignment between evidence and conclusions, or the validity of the scientific conclusion itself? The authors propose a four-layered auditing framework: 1. Historical audit (can numerical self-consistency coexist with misattribution?); 2. Contract testing (do two different checkers implement the same formal contract?); 3. Exploratory comparison (which failures warrant follow-up frozen experiments?); and 4. Frozen follow-up (at which layer do observed errors or improvements originate?). The experiments yield several key findings: 1. Safety improvements from a comprehensive, structured review process emerge even before the rule-based checks are applied. 2. No significant performance difference is observed between the two rule-based checkers. 3. Utilizing raw execution logs can rectify localized errors in evidence extraction. 4. A correct final label does not guarantee the correctness of the intermediate representations. 5. The authors' initial hypothesis was not supported by the experimental results.
Critical strengths
- The research addresses an important problem, and the conceptual distinctions made are of practical value.
- The experimental design is well-structured, effectively preserving intermediate judgments for analysis.
Critical weaknesses
- There is a significant lack of engagement with related work. The paper should cite more existing research on failure modes in AI-based review and verification systems [1–8].
[1] When AI Co-Scientists Fail: SPOT—a Benchmark for Automated Verification of Scientific Research.
[2] FLAWS: A Benchmark for Error Identification and Localization in Scientific Papers.
[3] LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing.
[4] AI Review Is a Systemic Risk to Peer Review: Toward a Blockchain-Supported Claim-Level Ledger for Accountability.
[5] PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistencies.
[6] Position: Stop Automating Peer Review Without Rigorous Evaluation.
[7] No Hidden Prompts Needed! You Can Game AI Peer Review with Presentation-Only Revisions.
[8] ProcessBench: Identifying Process Errors in Mathematical Reasoning.
-
The methodological contributions and novelty require further substantiation. The phenomenon described is already known (having been documented in several existing studies, such as those concerning ScientistOne). The authors' contributions are not yet sufficiently demonstrated.
-
The scale of the core experiments is very limited, consisting of only 4 data sources, 3 types of templates, and 12 workflows.
-
There is no explanation as to why the comprehensive structured review process is effective.
Questions for authors
- Is it possible to incorporate a larger and more naturalistic test set?
- Can an independent expert verification be provided? The reference labels and the review of historical cases relied on AI assistance, lacking adjudication by independent domain experts.
3 comments
lower my score from 2 to 1
The authors' use of AI to generate their rebuttal has resulted in a response consisting largely of vague and abstract statements that fail to address my concerns, such as how their work differs from the issues explored by ScientistOne. Therefore, I have decided to lower my score from 2 to 1.
A Final Clarification
I am a PIG. I only realized at the last moment that I had submitted my reviewer responses but had not submitted the revised manuscript.
This was my mistake, not an AI problem. At this stage, I used AI to help organize my rebuttal, but I did not ask it to check whether I had completed the submission process. Even a simple final check with AI could probably have prevented this stupid mistake. I take full responsibility.
Actually, the revised manuscript I prepared does include a direct comparison with ScientistOne.
In Section 2, we discuss ScientistOne and explain the differences between the two studies. ScientistOne focuses on building and checking evidence chains in autonomous research. Our work focuses on identifying where verification errors come from. We test what happens when only the evidence record is replaced while the claim stays unchanged.
In Section 7, we also explain how our repair experiments differ from ScientistOne. We test whether a repaired analysis actually answers the original research request, rather than simply producing a statement that matches the available evidence.
The revised manuscript also includes three extended studies, E01, E02, and E03, with additional experiments and results.
Unfortunately, I failed to submit this version. I understand that the reviewer could not see these changes. This was entirely my responsibility.
However, I would also like to raise one point about the ICLR reviewing rules.
ScientistOne is currently available as an arXiv preprint. The ICLR 2027 Reviewer Guidelines clearly state that authors are not required to compare their work with papers available only on arXiv, and that the lack of such comparisons cannot be a basis for rejection.
I agree that ScientistOne is relevant, and I have prepared a direct technical comparison. However, I believe that a missing comparison with an unpublished preprint should not itself be treated as grounds for rejection.
Again, I take full responsibility for my submission mistake. I apologize for it.
Response to QQW8
The revised contribution is evidence about where checking and repair break down. We follow a calculation, the model's description of it, the rule's decision, and the final answer to the original request. The larger studies show both useful corrections and cases where added checking fails.
We inspected relevant primary sections for seven of your eight suggested works (p. 2):
For AI Review Is a Systemic Risk to Peer Review, the claim-level ledger paper, the official workshop page confirms its title and three authors. Its primary full text remains unverified, so the technical comparison remains open. We also discuss CogEEGAgent, ClaimReceipt, Fisher-R1/P-Bench, extraction and alignment failures, and Steed et al.'s claim-to-code checks.
These works already establish many of the problems above. Our comparison asks which step changes the answer: the model's review, the checking rule, the supplied evidence, or a new analysis. We compare ordinary and RIEC checkers on the same records and requirements. Their agreement does not show a new checking advantage. Equal, reversed, and inconclusive results remain in the paper.
E01 uses eight datasets, 24 workflows, and 48 assertions: 648 contexts and 5,184 judgments across three xhigh configurations. For Luna, writing full records gives 3/60 false approvals versus direct review's 0/60 when short evidence cards include a checklist. With the same facts listed field by field, the counts are 0/60 versus 1/60, with or without a checklist. Writing out the evidence therefore helps or hurts depending on the condition (p. 5).
E02 adds 19 research projects, 33 workflows, and 62 original sentences paired with 62 predefined changes. We group shared authors into 17 groups and also check other source relationships. Some sentences admit more than one reasonable reading. Ambiguous references stay visible, and 1,775 of 3,348 answers cannot be used as valid whole-sentence predictions. In all 12 main comparisons, structured reviews matched the draft reference answers less often. Once missing or unusable answers are allowed for, either review approach could score higher (p. 6).
E03 uses 11 projects: nine shared-author groups, or eight with an additional shared-article rule. Ten projects overlap with E02, giving 20 distinct projects across both studies. Tables include coded, simulated, illustrative, and measurement-derived data. Repeated reviews remain grouped with their sources.
All 11 initial answers meet their specified analysis requests, so their 297 branches test whether checking preserves correct work. A separate 162-branch layer starts from six deliberately wrong analyses. Three illustrative new executions restore the requested coefficient, denominator filter, or training-only scaler fitting. Complete results retain technical failures and incomplete stages (p. 7; examples p. 49).
We retain the model's judgment before applying rules. Four E01 evidence records misstated how evaluation data were used. The ordinary rules withdrew none of the wrong approvals; replacing the evidence with actual execution records corrected 4/4 without changing the model's account of the sentence. These cases cover three workflows in one model/presentation setting. An extra validity flag also caused a correct model judgment to be lost. These traces show what went wrong and what information corrected it. The earlier exploratory drop in performance remains unreplicated, and its historical cause remains unresolved.
This request remains open: there are zero completed independent domain-expert judgments. We report the current references as AI-assisted drafts. Source-linked materials and blank forms omit model answers and expected labels. Numerical checks and offline replay support the specified calculations; independent review of sentence meaning is still outstanding.