- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
CAREER is a training-free framework for high-resolution visual question answering that couples multi-granularity evidence acquisition with sufficiency verification. The key insight is that individually relevant image regions do not guarantee the accumulated evidence is sufficient to distinguish among candidate answers.
The framework proceeds as follows. It first screens the global image and returns immediately if confidence and inter-option margin both exceed thresholds. Otherwise, it constructs a multi-scale candidate atlas combining SAM-based localization with a hierarchical SLIC region tree, ranked by query relevance and visual complexity. An evidence bundle retains all acquired observations for joint reasoning. An independent option-wise verifier then evaluates each answer option against the accumulated bundle, assigning Support, Refute, or Insufficient, without seeing the generator's provisional answer. The controller accepts when absolute support and normalized inter-option gap both pass thresholds, triggers backtracking when progress stalls, and returns the saved global answer as a flagged fallback when the budget is exhausted.
Experiments across three backbones on V*Bench, HR-Bench 4K/8K, and POPE-COCO show consistent accuracy improvements over visual search baselines, with lower latency and memory than CVSearch. Ablations confirm that evidence accumulation, adaptive navigation, and the two-threshold gate each contribute meaningfully to performance.
Critical strengths
S1: Consistent Gains Across Backbones and Settings
CAREER achieves the highest overall accuracy across all nine backbone–benchmark combinations in Table 1. The ablation drops for evidence retention and adaptive navigation are clear and consistent. Results hold across three generators and three high-resolution settings, which provides reasonable confidence that the gains are not cherry-picked.
S2: Accuracy and Computation Are Analyzed Together
Table S6 reports accuracy, mean observations, visual tokens, and latency at each observation budget, comparing CAREER against CVSearch and CVSearch with the same verifier. Across all four nonzero budgets, CAREER achieves higher accuracy and lower latency than both baselines. This joint analysis is more informative than accuracy-only comparisons and makes the efficiency claim concrete.
Critical weaknesses
W1: Limited Novelty Relative to Prior Work
The main contribution of CAREER is the closed-loop coupling of evidence accumulation, option-wise verification, adaptive navigation, and stopping decisions. While this system-level integration is meaningful, the individual components largely have precedents. Local search, hierarchical region partitioning, and visual-complexity-driven candidate ranking are already present in CVSearch, which also employs global screening, expert-assisted localization, semantic region decomposition, and complexity-driven traversal. The genuine incremental value therefore narrows to how the option-wise verifier interacts with the continuously retained evidence bundle — not a fundamentally new visual search paradigm. The paper would be stronger if it more precisely isolated this verifier-evidence coupling as the core novelty, rather than presenting the full pipeline as a novel framework.
W2: Restriction to Closed-Ended QA and Limited Verifier Generalization
The framework requires predefined answer options and calls the verifier once per option at each step. How CAREER generalizes to open-ended or free-form settings remains unclear. The normalized support share ρ t , i ρ t,i and the acceptance gap are both sensitive to the number of options and to how options are worded, yet these sensitivities are not analyzed. In addition, all verifier comparisons are restricted to the Qwen model family. It is therefore unclear whether the reported gains reflect general properties of the verification mechanism or are specific to this family.
W3: Sufficiency Verification Is Not Directly Grounded in Visual Evidence
The acceptance rule is built on the verifier's Support score and the inter-option gap. A verifier can, however, assign high-confidence Support due to language priors, option wording, or its own visual misinterpretation, without the relevant visual evidence being present in the bundle. The reported accuracy and accepted error rates show that the mechanism is useful in aggregate, but they do not directly show that the verifier detects whether critical visual evidence is actually present. The most informative validation would be targeted intervention experiments: occlude the key object, remove necessary context, or substitute the relevant crop, and check whether the verifier transitions from Support to Insufficient and whether search resumes. A comparison against removing irrelevant regions would further isolate whether the verifier responds to genuinely task-critical content.
W4: Fallback Strategy Is Underexplored
When the observation budget is exhausted, CAREER returns the saved global answer as an unverified fallback. The paper does not justify this choice or ablate alternatives. It is not clear why the global answer is preferred over using the accumulated evidence state at termination, which may contain more relevant information than the initial global view. No comparison is reported against, for example, returning the answer with the highest accumulated verifier support, or a weighted combination of global and search-phase predictions. Given that fallback accuracy is substantially lower than accepted accuracy — 62.22% versus 90.91% on HR-Bench 4K — the fallback branch is a meaningful source of error whose design deserves explicit analysis.
Questions for authors
Why does the fallback return the saved global answer rather than the answer with the highest accumulated verifier support at termination? Have alternative fallback strategies been compared?
Have the authors tested the verifier with a model outside the Qwen family? The current comparison covers six Qwen checkpoints but does not establish whether the gains are architecture-specific.
5 comments
Response to reviewer nr8V (part2)
W3. Testing sensitivity to adding, removing, and rephrasing answer options
Thank you for noting that normalized Support depends on the set of answer options. We tested how changes to the option set affect final answer accuracy on V*Bench, HR-4K, and HR-8K.
- Changing the number of options. For questions with four original options, we either remove one distractor using a fixed random seed (41) or add a distractor of the same type as the existing options and manually verify that it is incorrect. For questions with two original options, we test distractor addition only. For example, in a color question, we add a color absent from the target object. We preserve the wording of the correct answer and all retained options.
- Paraphrasing the options. We paraphrase the correct option and the distractors while preserving the number and order of the options and the identity of the correct answer. For example, we change
lefttoon the left sideanddark bluetoa dark shade of blue. We manually check that each paraphrase preserves the original attribute, direction, or numerical value and that the correct answer remains unique.
We rerun the full procedure for each setting and report final accuracy. For each question, we keep the image, question text, models, search budget, and acceptance thresholds fixed across the applicable settings. On V*Bench, we evaluate distractor removal on the 107 questions with four original answer options.
Table 1. Answer accuracy under changes to the answer options
| Option setting | V*Bench | HR-4K | HR-8K |
|---|---|---|---|
| Original options | 91.62% | 78.00% | 79.50% |
| Remove one distractor | 91.59% (98/107) | 78.50% | 80.00% |
| Add one distractor | 90.58% | 77.25% | 78.75% |
| Paraphrase the options | 91.10% | 77.75% | 79.25% |
With the acceptance thresholds held fixed, adding a distractor reduces final accuracy by 0.75 to 1.04 percentage points across the three evaluations. Paraphrasing changes accuracy by at most 0.52 percentage points.
W4. Comparing Qwen, Gemma, and Phi verifiers under matched settings
To test whether option-wise verification transfers across model families, we evaluated Gemma 3 4B IT and Phi-4-multimodal-instruct as verifiers. We vary the verifier while holding the generator, verification prompt, observation budget, and acceptance thresholds fixed.
Table 2. Answer accuracy across verifiers
| Verifier | V*Bench | HR-4K subset | HR-8K subset |
|---|---|---|---|
| Qwen2.5-VL-3B | 89.5% | 76.5% | 77.5% |
| Qwen3-VL-2B | 91.1% | 77.0% | 78.0% |
| Qwen2.5-VL-7B | 91.1% | 77.5% | 78.5% |
| Qwen3-VL-4B (default) | 91.6% | 78.5% | 79.5% |
| Qwen3-VL-8B | 92.1% | 79.0% | 80.0% |
| Qwen3-VL-32B | 92.7% | 79.5% | 79.0% |
| Gemma 3 4B IT | 91.1% | 78.0% | 79.0% |
| Phi-4-multimodal-instruct | 90.6% | 77.5% | 78.5% |
With the acceptance thresholds from the submitted configuration, Gemma and Phi remain within 1.0 percentage point of Qwen3-VL-4B (default) on all three evaluations. Both verifiers accept a slightly smaller share of answers and have a slightly higher error rate among accepted answers. These results show that CAREER's option-wise verification and search control can operate with the two non-Qwen families tested while maintaining comparable answer accuracy.
Response to reviewer nr8V (part3)
W5. Testing how blurring key visual evidence affects verification and search
Thank you for suggesting a direct intervention on the visual evidence. We reuse the 200 multiple-choice questions from the FineRS-4K region perturbation experiment and their annotations for key evidence and irrelevant regions. For each eligible question, we select the first decision step in the original trajectory at which local verification correctly accepted the answer, with observation budget remaining and a feasible next action available.
For each selected instance, we hold the question, options, and search state before the intervention fixed. We compare the original evidence bundle with two versions in which we blur either the key evidence region or the matched irrelevant region. Both interventions use local Gaussian blur with the same area and strength. We apply the blur to the full image and every local view containing the affected region. The verifier rescores all options, and the controller uses the original rule to decide whether to continue observing. We record whether the previously accepted correct option is reclassified as Insufficient and whether the system obtains at least one new valid observation.
Table 3. Paired evidence occlusion experiment
| Evidence condition | Mean Support for the originally accepted correct option | Reclassified as Insufficient after occlusion | Search resumed and obtained a new observation |
|---|---|---|---|
| Original evidence bundle | 0.86 | — | — |
| Blur the key evidence region | 0.47 | 58% | 72% |
| Blur the matched irrelevant region | 0.83 | 6% | 9% |
Blurring key evidence lowers mean Support for the originally accepted correct option from 0.86 to 0.47, and 58% of those options are reclassified as Insufficient. When the matched irrelevant region is blurred, mean Support stays at 0.83, and 6% are reclassified as Insufficient. The controller resumes search and obtains a new observation in 72% of instances after blurring key evidence, compared with 9% after blurring the irrelevant region. At decision steps where the system originally stopped with the correct answer, blurring question-relevant evidence more often leads the verifier to judge the evidence insufficient and the controller to continue searching.
W6. Testing whether Support tracks answer correctness and responds to missing evidence
To assess whether Support is suitable as an answer acceptance signal, we compare the verifier's Support probability with the generator's confidence in the same candidate on V*Bench. The candidate answer and visual evidence for each question are held fixed. Higher Support bins have higher observed accuracy. Support distinguishes correct from incorrect candidates with an AUROC of 0.85, compared with 0.75 for generator confidence.
The paired experiment in W5 (Table 3) also shows that blurring key evidence more often changes the verifier's judgment from Support to Insufficient than blurring a matched irrelevant region. The system also resumes search and obtains a new observation more often. The first experiment tests whether Support distinguishes correct from incorrect answers, and the second tests whether it responds to the loss of key visual evidence.
We will expand the appendix section on acceptance, error sources, and verifier choice to report the paired AUROC comparison and the evidence occlusion experiment described in W5.
Response to reviewer nr8V (part1)
Thank you for your detailed review and for noting the value of reporting accuracy alongside inference cost. We appreciate your suggestions on isolating CAREER’s contribution and testing whether verification responds to the presence of key visual evidence.
W1. Novelty relative to CVSearch under matched verification
Thank you for pointing out the similarities between CAREER and CVSearch. CVSearch already uses full-image screening, expert-assisted localization, hierarchical region partitioning, and complexity-guided search. CAREER extends this approach by verifying each answer option against accumulated evidence and using the verification results to control the search.
W2. Extending CAREER to open-ended question answering on FineRS-4K
To assess whether CAREER extends to open-ended question answering, we compared methods using the same backbone on the 744 open-ended test questions in FineRS-4K. In this setting, CAREER generates candidate short answers from the accumulated visual evidence. The verifier assesses each candidate, and the controller uses the results to decide whether to continue observing. CAREER generates all candidates during inference.
Under the same answer scoring protocol, full-image direct answering reaches 59.14%, and full-image generation followed by verification reaches 60.48%. CVSearch reaches 58.33%, increasing to 61.83% with verification after search. With the same maximum local observation budget, CAREER reaches 65.05%, outperforming the baseline that uses the same verifier only after search. This comparison supports the benefit of integrating answer verification into search for high-resolution, open-ended short-answer questions.