- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces Grounding Drift, a failure mode in long-horizon multimodal research where correctly established evidence or source/entity bindings become corrupted, omitted, or reassigned later in the reasoning process. To address this, the authors propose Cog-Research, which combines trajectory SFT with rubric-guided GRPO over Plan-and-Act traces, workspace artifacts, and task-specific evidence-linked criteria. Experiments on MMDeepResearch-Bench, DeepResearch-Bench II, and MiroEval show consistent improvements over the base model, including a reduction in Grounding Drift from 30.7% to 17.1%. Overall, the work is technically solid, well validated, and provides a useful framework for improving evidence preservation in multimodal deep-research agents.
Critical strengths
1、The paper identifies an important failure mode at the trajectory level. Requiring a correct upstream grounding followed by a downstream omission, corruption, or misbinding provides a concrete operational distinction from first-occurrence perception errors and unsupported hallucination.
2、The paper provides an annotation protocol, representative raw cases, an inter-annotator agreement study (Cohen's kappa = 0.766), and broader error-distribution analyses rather than relying only on final-answer metrics.
3、The experimental package is strong. The work reports three benchmarks, Base/SFT/SFT-RL comparisons, training-strategy ablations, reward-component ablations, run-to-run standard deviations, repetition diagnostics, atomic-capability retention metrics, compute costs, and reproducibility details.
Critical weaknesses
1、A report that preserves the same entities, values, and URLs but swaps their pairings can still receive substantial lexical/source-coverage reward. A controlled entity/value/source-swap stress test would make the mechanism more convincing, although this limitation is explicitly acknowledged and does not invalidate the current empirical results.
2、Some benchmark gains are intertwined with generic output stabilization. The Presentation Quality / hard-gate bundle has a large effect, and severe repetition drops substantially after RL. A more fine-grained separation of grounding-specific gains from output-quality stabilization would sharpen the causal story.
3、The novelty is strongest as a trajectory-level diagnostic lens and training formulation rather than as an entirely new primitive failure type. The appendix shows overlap with context loss, citation/source-reference errors, and entity confusion. I think the current framing is still useful, but this boundary should remain explicit.
4、The central 43-to-24 Grounding Drift reduction is presented as task counts from a diagnostic pass. A paired confidence interval, bootstrap analysis, or similar uncertainty estimate would further strengthen the main claim.
Questions for authors
1、Can the authors provide a controlled entity/value/source-swap evaluation of the deterministic reward, showing how much the reward changes when a correct report is modified only by swapping bindings while preserving the same tokens and URLs?
2、The Process-only variant has 23 primary Grounding Drift errors versus 24 for the full SFT-RL model. Do the authors interpret the main benefit of the joint objective as stronger cross-benchmark transfer rather than strictly lower drift incidence?
3、Can the authors provide a paired uncertainty analysis for the reduction from 43/140 to 24/140 Grounding Drift cases?
4、Could Presentation Quality, repetition penalties, and hard-error gates be ablated separately rather than as a bundle, to better isolate the contribution of grounding-specific supervision?
3 comments
W3. The novelty is strongest as a trajectory-level diagnostic lens and training formulation rather than as an entirely new primitive failure type. The appendix shows overlap with context loss, citation/source-reference errors, and entity confusion. I think the current framing is still useful, but this boundary should remain explicit.
We agree that this boundary should remain explicit, and the manuscript states it in Section 3 and Appendix A.1. Grounding Drift is proposed as a trajectory-level failure pattern rather than an entirely new primitive error type. It requires three conditions: (1) correct grounding was established upstream; (2) the information remains relevant to the task; and (3) a downstream state omits, corrupts, or misbinds it without supporting evidence. This temporal requirement distinguishes Grounding Drift from initial perception errors and isolated hallucinations.
W4. The central 43-to-24 Grounding Drift reduction is presented as task counts from a diagnostic pass. A paired confidence interval, bootstrap analysis, or similar uncertainty estimate would further strengthen the main claim.
Q3. Can the authors provide a paired uncertainty analysis for the reduction from 43/140 to 24/140 Grounding Drift cases?
For each pairing, the exact McNemar test and a 95% paired bootstrap interval over tasks are well defined, and Table R3 reports their envelope across pairings.
Table R3. Sensitivity bounds for the Grounding Drift reduction.
| Statistic | Result |
|---|---|
| Base Drift incidence | 43/140 (30.71%) |
| Full Drift incidence | 24/140 (17.14%) |
| Absolute reduction | 13.57 percentage points |
| Two-sided exact McNemar p-value across the 25 pairings | 0.0000038–0.0271 |
| Envelope of 95% bootstrap intervals across pairings (Full − Base) | [−25.00, −2.14] pp |
The McNemar p-value does not exceed 0.0271 under any pairing, so the reduction does not depend on one particular pairing.
Q2. The Process-only variant has 23 primary Grounding Drift errors versus 24 for the full SFT-RL model. Do the authors interpret the main benefit of the joint objective as stronger cross-benchmark transfer rather than strictly lower drift incidence?
Yes. We interpret the main additional benefit of joint RL as stronger cross-benchmark generalization, rather than strictly lower Grounding Drift incidence (Section 5.4).
Table R4. Process-only vs. joint RL (paper Table 3 and Table 2).
| Metric | Process-only | Full |
|---|---|---|
| MMDeepResearch-Bench Overall | 27.98 | 28.07 |
| Primary Grounding Drift | 23/140 | 24/140 |
| MiroEval-Multimodal Overall | 49.53 | 53.27 |
Process-only has the lowest observed primary Drift count, but the joint objective gives the stronger cross-benchmark result. Combining process and outcome rewards improves transfer across different deep-research evaluation settings.
We would like to hear back from reviewer aUwC
Dear reviewer aUwC,
We would like to follow up to see if the response addresses your concerns. We would really appreciate the opportunity to discuss this further if our response has not already addressed your concerns. Thank you again!
Response to Reviewer aUwC
Thank you for your valuable feedback to help us improve our paper. We have revised our paper based on your feedback. We detail our response below and please kindly let us know if our response addresses your concerns.
Controlled relation-level stress test. The reviewer's quoted sentence described the token-coverage evaluator of the submitted manuscript. We did not test it against relation-level perturbations, and we presented the limitation as applying to the whole reward. This was too broad, and we correct it here. The source-indexed verifier resolves report citation markers through the reference list, indexes (source, entity, attribute, value) facts, and checks parseable claims against the cited source (Appendix A.5). Table R1 reports its decisions on eight tasks, including Q28, Q101, and Q133, with 100 controlled cases per class.
The source-indexed verifier flagged all 100 entity–value swaps, 100 citation-pointer swaps, and 100 same-token contradictions, but only 8 of 100 unsupported claims carrying a valid URL. Detection refers to verifier decisions, not to the magnitude of the final reward. The verifier therefore reliably detects parseable binding corruption, while verification of individual free-form claim support remains a stated limitation.
Table R1. Source-indexed verifier sensitivity to controlled relation changes.
It should be acknowledged that the detection does not cover everything. It applies to parseable assertions whose cited source has a sufficiently complete fact index. Unsupported free-form claims that carry a valid URL mostly remain undecided. The verifier is therefore a targeted check of binding relations, not a general semantic entailment judgment. Section 4.4.1 and Limitations (Appendix A.7) state these boundaries.
We ablated Presentation Quality and Hard Gates separately rather than as one bundle (Table R2a, Table R2b).
Table R2a. Ablations on MMDeepResearch-Bench.
Table R2b. Ablations on MiroEval-Multimodal.
Removing Presentation Quality lowers GEN and Clarity (−3.22 and −4.50 points), while removing Hard Gates causes the larger degradation (Overall −4.04 on MMDeepResearch-Bench and −4.16 on MiroEval-Multimodal). Both removals also lower the grounding-specific metrics (EVI by 2.04 and 4.23 points; VEF by 5.56 and 6.94 points), so the controls are not purely stabilization terms. Their effect on grounding is nonetheless coupled to output stabilization (Appendix A.15).