- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces OneSearch-VL, a unified multimodal deep-research agent that handles single-image, multi-image, and video inputs through a unified tool-use framework. The paper proposes the Visually Grounded Evidence Graph (VGEG), which connects visual anchors, real-world entities, source-supported facts, and the operations required to produce final answers. Building on this representation, the authors construct training data and expert trajectories and introduce a reward mechanism based on the Evidence-aware Visual-Grounded Rubric (EVGR) to supervise evidence traceability and visual grounding during reinforcement learning. Experimental results show that the proposed method outperforms existing baselines on several established and newly constructed benchmarks.
Critical strengths
The paper studies how multimodal agents can connect visual observations with external knowledge and combine evidence across images and videos. This is a valuable research direction that goes beyond traditional visual question answering.
Meanwhile, VGEG provides a unified representation for data construction, trajectory filtering, reward design, and operation-oriented evaluation. The experiments also provide meaningful preliminary evidence for the effectiveness of the proposed approach.
Critical weaknesses
The paper introduces several interrelated concepts and presents them as an integrated framework, but the methodological innovations themselves remain insufficiently distinctive. The overall approach appears more like a combination of existing techniques than a clearly differentiated new methodology. The current ablation studies demonstrate that the overall system is effective, but they do not sufficiently establish that the specific design choices are necessary or superior to simpler alternatives. The authors should therefore provide a more explicit comparison of VGEG and EVGR with the most relevant evidence-graph and process-supervision methods.
The evaluation also relies on LLM-based judgments of answer correctness and trajectory quality. Since the proposed reward mechanism likewise depends on structured assessments of evidence support and visual grounding, systematic errors in the evaluator could affect both training and final evaluation.
The paper introduces new benchmarks, but it remains unclear whether these benchmarks independently assess general multimodal research capabilities or favor the specific operations and evidence structures emphasized during training. The authors should further analyze potential overlap between the training and test sets, the diversity of data sources, and the model's generalization to out-of-distribution tasks.
Questions for authors
-
What are the most important technical differences between VGEG and existing evidence-graph or knowledge-grounding representations?
-
How reliable is the LLM-based EVGR evaluator? Have the authors assessed the agreement between its scores and human annotations or independent evaluators? Could systematic biases cause the evaluator to assign higher scores to trajectories that conform more closely to the proposed rubric?
-
How do the authors control for potential overlap between the training data and the two newly introduced benchmarks?
4 comments
Response to Reviewer 7d2H (2/2) — Evaluator reliability and benchmark generalization
Q2. Reliability of the LLM-based EVGR evaluator and potential rubric bias
1. Agreement between EVGR scores and human ratings
For each of Trace and Ground, the human evaluation protocol groups rollouts by their original Seed 2.0 Pro scores using ten equal-width bins over the 0–1 range. We randomly sample 50 unmodified RL rollouts from each bin, for a total of 500 per dimension. Five annotators take part. Two independently score each rollout on a 0–1 scale using the question, source media, and tool records. Neither sees the judge’s original score or the other annotator’s rating. The human reference score is normally the average of the two ratings.
For each rollout, we pair the judge’s original score with the human reference score. We report the mean absolute error (MAE) and the share of valid pairs whose scores differ by at most 0.10. The shares were 85.4% for Trace and 84.4% for Ground, with MAEs of 0.046 and 0.050, respectively. The similar agreement rates and low MAEs indicate that Seed 2.0 Pro generally scores both Trace and Ground close to the independent human ratings on the sampled rollouts.
2. Could systematic biases cause the evaluator to assign higher scores to trajectories that conform more closely to the proposed rubric?
To test whether the evaluator favors wording that more closely matches the proposed rubric, we sample up to 500 saved RL rollouts for each of Trace and Ground as version A. For B, we give the proposed rubric to an LLM and ask it to rewrite the wording to match the rubric more closely while preserving the original meaning and evidence. C introduces an error in one key piece of evidence, and D applies both changes. All other content stays fixed, and the same judge scores all four versions.
| Evidence | Original wording | Rewritten wording |
|---|---|---|
| Sufficient | A. Original rollout with sufficient evidence. | B. Keep A’s evidence and meaning, and rewrite its wording to more closely match the proposed rubric. |
| One key error | C. Keep the original wording and introduce an error in one key piece of evidence. | D. Keep C’s evidence and use the rewritten wording from B. |
Paired score differences
| Metric | Trace | Ground |
|---|---|---|
| Wording (A − B) | +0.004 | 0.0 |
| Wording (C − D) | +0.011 | +0.014 |
| Evidence (A − C) | +0.196 | +0.228 |
| Evidence (B − D) | +0.203 | +0.241 |
The score differences are on the original 0–1 scale. In these paired comparisons, rewriting with reference to the proposed rubric does not noticeably raise scores when the evidence and meaning stay fixed. Introducing an error in key evidence while keeping the wording fixed substantially lowers scores.
Q3. Controlling for potential overlap between training data and the two new benchmarks
Training and benchmark separation. Neither benchmark shares source YouTube videos or visual entities used to construct questions with SFT-110K or RL-10K. Before building the training sets, we used YouTube video IDs, upload channels, and the visual entities used to construct questions to split the source videos into a training pool of about 65K videos and a benchmark pool of about 5K. We kept all videos from the same channel in the same pool. Each clip, extracted frame, and derived multi-image question stayed in the pool of its source video.
Diversity of benchmark sources. Together, the two benchmarks contain 608 questions across six domains: daily life (222), entertainment (153), geography (84), technology (58), sports (51), and news (40). All six research operations appear in every domain, though their proportions vary.
Cross-benchmark generalization. To test whether the model’s research capabilities transfer beyond the two OneSearch benchmarks, we also evaluated it on external image and video benchmarks. Across seven existing single-image deep research benchmarks, OneSearch-VL-8B achieves an average score of 58.3, compared with 56.6 for OpenSearch-VL-8B. On the independently developed VideoDR benchmark, OneSearch-VL-8B achieves 57.0% accuracy, compared with 47.0% for OpenSearch-VL-8B and 30.0% for tool-augmented Qwen3-VL-8B.
Sincere Thanks and Follow-up to Reviewer 7d2H
Dear Reviewer 7d2H,
Thank you again for taking the time to review our manuscript and share your feedback. We have responded to your comments and revised the manuscript accordingly. We hope that our responses and revisions address your concerns. If any questions or concerns remain, we would be happy to address them during the discussion period.
Best regards,
The Authors
Follow-up on our rebuttal
Dear Reviewer 7d2H,
As the discussion period is drawing to a close, we would like to gently follow up on our rebuttal and the additional experiments addressing your comments on OneSearch-VL. We would appreciate your feedback on whether our responses have addressed your remaining concerns, and would be happy to provide any further clarification before the deadline.
Thank you for your time and constructive feedback.
Best regards, The Authors
Response to Reviewer 7d2H (1/2) — What VGEG represents
VGEG’s technical differences, evaluator reliability, and cross-benchmark generalization
Thank you for asking us to clarify what VGEG represents and what our evaluation covers.
Q1. Technical differences between VGEG and existing evidence-graph or knowledge-grounding representations
In video and multi-image deep research tasks, relevant entities often appear in different frames or images. Reasoning depth is the number of hops along entity relations needed to retrieve a fact. Reasoning breadth is the number of visual anchors whose evidence must be combined to answer the question. VGEG records both kinds of dependencies in one graph per question.
Existing evidence graphs and knowledge grounding. SearchEyes builds graphs from entities and relations already present in knowledge bases such as Wikidata5M. CaRR identifies the entities and facts to verify in a text question. STAMP starts with entities from Wikipedia and follows relations over multiple hops to build its graph. In video and multi-image deep research tasks, a question built only around entities and relations retrieved in advance can still require many retrieval hops. However, it may leave out other entities in the visual inputs and their relations, reducing the need to combine evidence across frames or images.
Task representation in existing video deep research methods. VideoSearcher uses entities from existing image QA pairs to find videos and then adapts the questions to the video content. This can preserve the original multi-hop retrieval requirements, but the breadth of each new question still depends largely on the entities in the original question. Other objects in the video and their relations may therefore play no role in the reasoning. Video-DeepResearch localizes objects in videos and uses verified keyframes, bounding boxes, entities, and search summaries to construct QA pairs. Selecting multiple entities can broaden the scope of a question. Its representation, however, neither traces the multi-hop evidence chain from each anchor nor specifies which facts from different anchors feed each answer operation.
Although VGEG may initially seem like a combination of existing ideas, our core contributions include building question-specific evidence graphs from visual inputs to satisfy both reasoning depth and breadth, and designing the full data construction pipeline based on the graph. The graph captures reasoning depth through evidence chains that can span multiple hops along entity relations, linking each visual anchor to the facts needed for the answer. It captures reasoning breadth by specifying which facts retrieved from different anchors are combined in each answer operation. Using the same graph, we can both verify each evidence chain and check whether facts from different frames or images can be combined to derive the answer.
We also evaluated VideoSearcher-8B on both OneSearch benchmarks. The comparison shows that OneSearch-VL-8B has a clear advantage on questions that require combining evidence across visual anchors.
OneSearch-MI-Bench (accuracy, %)
OneSearch-Video-Bench (accuracy, %)