- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies how the hallucination-related reliability of a language model changes when it operates within agent scaffolds. It introduces ScaffoldShift, a synthetic benchmark of 2,360 cases across six task families. The families cover evidence applicability, missing tools, tool and parameter selection, execution-failure reporting, error localization and recovery, and multi-source conflict resolution. Each case is evaluated in two views. In the agent view, the model operates within a scaffold and interacts with a deterministic environment. In the LLM view, the same model is shown a fixed reference trajectory and asked only for a final assessment. Outputs are scored programmatically against hidden structured answers. Experiments with five models and five scaffolds report two main findings: accuracy can rise or fall relative to the LLM view depending on the configuration, and the task families most sensitive to scaffold choice differ between stronger and weaker models.
Critical strengths
- The paper addresses an important and timely problem. As language models are increasingly deployed within agent scaffolds, it is relevant for both research and practice to understand how the scaffold changes a model’s reliability, rather than evaluating the agent only as a complete system.
Critical weaknesses
-
The framing of the paper does not match what is measured. The paper is presented as a study of how scaffolds change a model’s hallucination behavior, but the benchmark essentially measures tool-related hallucination. All task families concern tool-mediated decisions, such as tool availability, argument values, execution outcomes, and the applicability of tool-returned evidence. Each scaffold is connected through an adapter that exposes only the benchmark’s synthetic tools. As a result, components that distinguish scaffolds, such as context management, memory, planning, and long-horizon control, are largely not exercised. In addition, the authors themselves note that the reported accuracy is not a measure of how often unsupported claims occur. The study is therefore closer to an evaluation of tool-use reliability across agent frameworks than to a study of scaffold-associated hallucination.
-
The novelty of the benchmark is limited, and the comparison that could provide it is difficult to trust. The individual task families overlap substantially with existing studies, some of which cover a broader range. RelyToolBench already evaluates tool selection hallucination, including fabricated tools, and tool usage hallucination, with deferral and clarification as valid actions. RGB evaluates retrieval grounding under noisy, missing, and counterfactual evidence, which relates to the evidence-applicability and conflict families. AgentHallu covers trajectories from multiple agent frameworks with a broader hallucination taxonomy spanning planning, retrieval, reasoning, human interaction, and tool use. HAL already compares the same models across multiple scaffolds at a large scale. These works are cited, but the differences from them are described only briefly, and the positioning of the benchmark relative to them remains unclear. The main remaining contribution is therefore the pairing of the agent view with the LLM view. However, the LLM view is an unnatural setting for the model. The model is asked to produce free replies, including one before any evidence is shown. These replies cannot affect the trajectory but remain in the context, while the controller injects reference calls the model did not choose. The authors acknowledge that these replies can influence later reasoning, yet this effect is not analyzed. Notably, for the stronger models, the LLM view scores well below most agents on the harder families even though it receives the reference trajectory. This suggests that the measured differences may partly reflect artifacts of this protocol rather than effects of the scaffolds. Since the main findings are also reported to hold without the LLM view, the pairing contributes little to the conclusions.
-
As a minor point, the paper contains many defensive qualifications, such as repeated statements of what a result does not establish. The volume of these qualifications makes it difficult to identify what the paper actually claims.
Questions for authors
-
How does ScaffoldShift differ from existing work such as HAL, AgentHallu, and RelyToolBench, beyond combining their elements? A clearer explanation, for example a comparison of benchmark properties, would help clarify what this benchmark enables that these works do not.
-
Could the authors examine how the design of the LLM view itself affects its accuracy? In this view, the model produces intermediate replies that cannot affect the trajectory, while reference calls it did not choose are injected into the context, which may degrade its performance. Quantitative experiments or an explanation addressing this effect would help clarify whether the differences between the two views reflect the scaffolds rather than the LLM-view protocol.
-
Every accuracy reported in Table 1 corresponds to a number of passing cases that is an exact multiple of ten. Given the family sizes and the variant structure described in Appendix A, this pattern seems unlikely if each of the 2,360 cases were scored individually. Could the authors describe how the evaluation was conducted?