acceptodds
Withdrawn from ICLR 2027

DERIVE: Dependency-Aware and Evidence-Responsive Reasoning via Intervention and Verifiable Execution for MLLM Long-Document Understanding

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Multimodal large language models (MLLMs) typically tackle long-document reasoning by retrieving sparse evidence from abundant irrelevant pages before reasoning over it. Yet our analysis shows that substantial errors persist even when gold evidence is directly provided, shifting the challenge from locating evidence to reasoning reliably from it. However, existing methods mainly verify final outcomes or individual reasoning states, which does not establish whether downstream reasoning actually depends on the answer-determining evidence. We therefore propose Dependency-aware Evidence-responsive Reasoning via Intervention and Verifiable Execution (DERIVE), which makes evidence-to-reasoning dependencies explicit and executable through Verifiable Execution (VE) chains, and makes them directly testable through controlled Evidence Intervention (EI). VE chains expose evidence provenance and intermediate execution to deterministic verification, while EI modifies answer-determining evidence and re-executes the affected downstream reasoning to produce verifiable dependency responses. DERIVE is trained with VE-chain SFT establishing the grounded executable reasoning format, followed by GRPO with executable verification over original and intervened evidence states to reinforce grounded, executable, and evidence-responsive reasoning. Extensive experiments on six public benchmarks demonstrate that DERIVE consistently outperforms competitive baselines, especially on arithmetic-intensive tasks requiring evidence-dependent reasoning. Code will be released upon acceptance.

Primary area:
foundation or frontier models, including LLMs
Keywords:
Multimodal Large Language Models (MLLMs), Long-Document Understanding, Document VQA

Reviews

Among:
Shape:
1234this paper, Bottom 2%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.33 over 3 reviews, above 2% of the others.
Reviewer_k3ZgOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper proposes DERIVE, a framework for improving evidence-based reasoning in multimodal long-document question answering. Its motivation is that locating the correct evidence does not ensure that a model reads, combines, and uses that evidence correctly. DERIVE represents reasoning as Verifiable Execution chains, which connect document-grounded values through executable operations. It also introduces Evidence Intervention, which modifies answer-determining document content and recomputes the corresponding reasoning targets. The model is trained through supervised fine-tuning followed by reinforcement learning with rewards for answer correctness, evidence grounding, execution consistency, and intervention responsiveness. Experiments use Qwen2.5-VL-3B and 7B across six benchmarks, with the largest reported improvements on arithmetic-intensive document questions.

Critical strengths
  1. The paper addresses an important limitation beyond evidence retrieval.

    The observation that models still fail when relevant evidence is provided motivates studying evidence interpretation and use. This is a useful direction for document question answering, where retrieving the right page is only one step toward producing a reliable answer.

  2. The proposed representation makes parts of the reasoning process directly checkable.

    Explicit READ operations, variable references, and executable computations allow the system to inspect evidence provenance and intermediate calculations. Combining this representation with controlled document edits provides a concrete way to evaluate whether generated answers respond appropriately to changes in relevant evidence.

  3. The evaluation covers multiple tasks and includes useful component analyses.

    The experimental design includes six benchmarks, two model sizes, and two datasets excluded from training. The paper also examines paired evidence edits, different answer types, training stages, reward-signal availability, and computational costs. These analyses provide several perspectives on the proposed approach.

Critical weaknesses
  1. Important related methods and executable-reasoning baselines are missing.

    [DocSeeker][docseeker] and [LAT][lat] are particularly relevant because they already combine structured reasoning, evidence supervision, and reinforcement learning, yet neither is included in the experimental comparisons. [PoT][pot]/[PAL][pal]-style baselines are also important for determining how much of the arithmetic improvement comes from representing computations as executable programs. Additional relevant document systems include [HiEvi-RAG][hievi], [Doc-V*][docv], and [DocLens][doclens], although comparisons with these systems should account for differences in backbone and inference budget. Without these comparisons, the contribution beyond existing evidence-grounded and program-based reasoning methods remains insufficiently established.

  2. The evidence does not fully support the claim that the model's reasoning dependencies have been verified.

    Successful execution of a generated chain demonstrates a property of the output program, while correct answers on paired document edits provide behavioral evidence of responsiveness. Neither establishes that the model actually relied on the displayed chain when generating its answer. Furthermore, a program can produce correct outputs for an original value and one replacement while implementing an incorrect general rule. More varied interventions, irrelevant-evidence controls, and independent checks of chain-answer consistency are needed to support the stronger dependency-verification claims.

  3. The verifier checks only part of what reliable evidence-grounded reasoning requires.

    The grounding reward checks whether a value occurs on the cited page, rather than explicitly verifying the predicted bounding box or its semantic role. Repeated numbers can therefore receive grounding credit despite being associated with the wrong row, year, or entity. Similarly, executable consistency establishes that an operation was performed correctly, but not that the operation was appropriate or that all necessary evidence was included. These limitations weaken the interpretation of the rewards as comprehensive process verification.

  4. The ablations do not fully isolate the sources of improvement.

    Freezing the retrieval head does not guarantee identical retrieved pages because the upstream language-model layers are updated through LoRA. Some improvements could therefore involve changes in evidence selection. Figure 4 also compares SFT against GRPO with intervention data, changing both the training procedure and the data simultaneously. Consequently, the corresponding gain cannot be attributed solely to additional intervention data. Stronger controls should hold retrieved pages, training examples, update counts, and rollout budgets constant.

  5. The intervention evaluation and statistical reporting are insufficiently documented.

    The paper does not adequately specify the source split, selection criteria, filtering rate, or document-level separation of the 505 intervention pairs. This matters because the base model's original-state accuracy on this set is much lower than its main TAT-DQA result. The intervention labels are also generated by re-executing the original chain, which can preserve semantic mistakes in that chain. Finally, the main comparisons lack reported uncertainty or repeated-run results, making it difficult to assess the reliability of relatively small improvements.

  6. Numerical inconsistencies and incomplete methodological reporting undermine confidence in the conclusions.

    The manuscript mixes evaluation metrics in its baseline comparisons, reports overall scores that do not match the corresponding subgroup results, and contains inconsistencies in conditional accuracy and parameter percentages. Its stated GRPO objective also omits important elements of the standard formulation without explaining the actual implementation. These issues require correction and access to the underlying evaluation details before the reported comparisons and component-level conclusions can be assessed confidently.

Questions for authors

The following list distinguishes directly checkable errors from issues that could potentially be explained by an undocumented evaluation or implementation choice.

  1. Table 1 mixes EM and ANLS in the same benchmark columns.

    Section 4.1 states that SlideVQA and TAT-DQA are evaluated using Exact Match. However, the borrowed DocR1 results—71.9 for SlideVQA and 64.8 for TAT-DQA—correspond to results reported as ANLS in the original paper. The published [DocR1][docr1] table explicitly uses ANLS and reports 71.96 and 64.80. The borrowed mPLUG-DocOwl2 results also match values in that ANLS table. These scores cannot be treated as directly comparable EM results without reevaluation.

  2. Table 2's overall scores do not match its subgroup scores.

    The manuscript states that it evaluates the complete 1,091-question MMLongBench-Doc benchmark. The corresponding [official dataset description][mmlong] contains 485 single-page, 360 multi-page, and 246 unanswerable questions.

    Using these counts to aggregate the reported subgroup scores gives:

    ModelSingle-pageMulti-pageUnanswerableRecomputed overallReported overall
    DERIVE-3B38.216.739.531.4033.5
    DERIVE-7B39.518.466.038.5135.6

    The calculation is:

    = \frac{485\,\mathrm{SIN}+360\,\mathrm{MUL}+246\,\mathrm{UNA}}{1091}.$$ These differences are too large to result from rounding. If different subsets, metrics, or dataset versions were used, they must be identified explicitly.
  3. Table 3 contains an inconsistent conditional accuracy.

    For free-CoT+GRPO, original accuracy is 51.2% and joint accuracy is 41.8%. Under the table's pooled interpretation, the conditional intervention accuracy should be:

    41.851.2×100≈81.64%,\frac{41.8}{51.2}\times100\approx81.64\%,

    rather than the reported 79.6%. If the columns instead contain separately averaged statistics across runs, the aggregation procedure must be specified.

  4. Two Table 3 percentages are incompatible with a single binary evaluation over 505 pairs.

    With 505 examples, 258 and 259 correct predictions produce 51.1% and 51.3% after rounding; neither produces the reported 51.2%. Likewise, 230 and 231 correct predictions produce 45.5% and 45.7%, rather than the reported 45.6%. These values could arise from averaging multiple runs, but no such protocol is reported.

  5. Table 5's answerability and document-length breakdowns cannot both describe the same evaluation under a common averaging scheme.

    For the baseline, the answerable and unanswerable scores are 44.7 and 0.4. Since every document-length group scores at most 39.7, the unanswerable fraction must be at least approximately 11.3%.

    For VE-chain SFT, the answerable and unanswerable scores are 42.4 and 85.1. Since every document-length group scores at most 44.3, the unanswerable fraction must be at most approximately 4.45%.

    The same evaluation set cannot satisfy both constraints. Different subsets or aggregation rules would need to be disclosed.

  6. The improvement stated in Section 4.2 is arithmetically incorrect.

    The paper states that DERIVE-7B improves over URaG-7B by 2.1 points on MMLongBench-Doc. Table 2 instead gives:

    35.6−33.7=1.9.35.6-33.7=\mathbf{1.9}.

  7. Figure 2 contains an incorrect intermediate computation after intervention.

    The edited chain changes the evidence value from 172.1 to 172.2 while retaining the other value at 304.7. The subtraction should therefore produce 132.5, but the intermediate result remains 132.6, while the final answer is shown as 132.5. The example is internally inconsistent.

  8. Table 6 uses a denominator inconsistent with its caption.

    The caption states that parameter percentages exclude output embeddings. However, the reported percentages correspond approximately to the total model size. For example:

    59.87M/3.446B≈1.74%,59.87\text{M}/3.446\text{B}\approx1.74\%,

    rather than the reported 1.593%. Similarly:

    80.74M/7.751B≈1.04%,80.74\text{M}/7.751\text{B}\approx1.04\%,

    rather than 0.973%. The main text's 1.57% figure for the 3B model also differs from the table's approximately 1.59%.

  9. Equation 9 does not specify the standard GRPO objective.

    The stated loss is an advantage-weighted log-likelihood objective. It omits the old-policy probability ratio, clipping, and the KL term present in the [original GRPO formulation][grpo]. This may be an intentional simplification or variant, but the actual objective, update schedule, and relevant hyperparameters must be provided. The omission alone does not establish that the implementation is incorrect.

  10. The statement about avoiding negative advantages for semantically correct answers is mathematically inaccurate.

    Recognizing alternative valid answers prevents false incorrectness labels. It does not prevent negative group-relative advantages:

    Ai=(ri−rˉ)/(sr+ϵ).A_i=(r_i-\bar r)/(s_r+\epsilon).

    A correct response with a lower process reward than other correct responses can still receive a negative advantage.

Reviewer_nHTbOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
3
Soundness
1
Read review
Paper summary

DERIVE trains a multimodal LLM for long-document QA to reason through executable "VE chains": grounded reads followed by operators such as SUB or COUNT, formulating a skeleton that can be re-run. It adds Evidence Intervention (EI), which edits one answer-determining value in the page image and recomputes the label by re-running the chain. Qwen2.5-VL-3B/7B is trained with VE-chain SFT on MPDocVQA, DUDE, SlideVQA and TAT-DQA, then with GRPO under a rule-based reward on original and edited documents.

Critical strengths
  1. Combining VE chains + EI is a cheap and smart way to build counterfactual document pairs with verifiable rewards to scale up training samples for RL -- editing one value in the page and re-running the chain gives the new label.
Critical weaknesses
  1. Both VE and EI are established techniques in existing work, for example, VE chains are extract-then-execute programs, as in FinQA and TAT-QA's TagOp, and EI is counterfactual data augmentation, i.e. TAT-HQA.

  2. The experiment numbers seem conflicting, see questions below.

Questions for authors
  1. The second bullet point of the paper's contribution mentions VE and EI as a major contribution, where both techniques are existing, but not mentioned, I believe it needs a better positioning.

  2. I am not able to reproduce the reported overall accuracy in Table 2 based on the other columns and the task split from MMLongBench-Doc, I used the (494 / 365 / 223) split over SIN/MUL/UNA and calculated the weighted avg but get different numbers from the reported overall ACC column.

Reviewer_CBNBOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes the DERIVE method, which makes the dependencies between evidence and reasoning in MLLMs explicit and verifiable through chains of Verifiable Execution and Evidence Interventions, training the model using SFT and GRPO with executable verification. The main contribution is the shift from verifying the correctness of individual steps to verifying whether subsequent reasoning depends on the extracted evidence and responds to its changes. Experiments on six document understanding benchmarks (MPDocVQA, DUDE, SlideVQA, MMLongBench-Doc, LongDocURL and TAT-DQA) showed moderate improvements over several competitive baselines, with stronger gain on arithmetic-intensive reasoning tasks.

Critical strengths
  1. I consider the development of the training pipeline a strength of this work. In particular, I value the preparation of structured data for more detailed supervision. Problem decomposition used in this work and generated data may support further research in this area.
  2. I also find the analysis of limitations in multimodal RAG systems valuable. It highlights difficulties in processing retrieved information as a major bottleneck, even when the correct evidence is provided. I see the shift toward post-retrieval reasoning and evidence-to-reasoning dependencies as a promising research direction. It may improve how MLLMs work with long documents.
Critical weaknesses
  1. I find the paper difficult to follow in places. Figure 2, in particular, seems overly complex and does not clearly explain the overall process. It may even make the method harder to understand.

  2. The main weakness of the paper is the complexity of preparing training data for DERIVE. This includes constructing Verifiable Execution chains with GPT-5.6 as a teacher and creating Evidence Interventions. Training also involves three stages: internal cross-modal retrieval, VE-chain supervised fine-tuning, and dependency-aware evidence-responsive GRPO.

Despite this complexity, the additional gains over simpler variants are often modest. In Figure 4, adding VE-chain verification to GRPO on the same intervention data improves DUDE by 0.5 points, SlideVQA by 0.8, MPDocVQA by 1.1, and TAT-DQA by 2.05. In my view, these incremental gains do not sufficiently justify the added complexity of the full pipeline.

Questions for authors

Could you clarify how the SFT-only and SFT + GRPO variants are compared in terms of training budget? Do they use comparable compute and process the same number of training trajectories? Or does the SFT + GRPO variant receive additional training, using more compute and seeing more trajectories than SFT alone?

Given the relatively modest gains from adding GRPO, could you compare these variants under matched training budgets, for example, with the same number of training trajectories or the same total training compute? This would help assess whether the training pipeline could be simplified by using SFT alone.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.