- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes DocHyper, a multimodal hypergraph-based retrieval framework for long-document question answering. The method extracts entities from text, tables, images, and charts, and organizes them into within-element and cross-element hyperedges. It then performs dual-path entity- and hyperedge-level retrieval, mapping the retrieved evidence back to source-page images for VLM-based answer generation. Experiments on LongDocURL and MMLongBench-Doc demonstrate improvements over several chunk-based, graph-based, and multimodal retrieval baselines, with additional ablation studies investigating the contributions of different retrieval structures.
Critical strengths
-
Relevant problem and practical framework. The paper addresses an important challenge in long-document QA: retrieving and organizing heterogeneous evidence distributed across text, tables, and figures. The proposed framework provides a coherent pipeline for multimodal evidence indexing, structured retrieval, and source-page grounding.
-
Promising empirical results and useful ablation studies. DocHyper achieves competitive improvements on two established long-document QA benchmarks. The experiments cover multiple retrieval paradigms, and the ablation studies provide useful evidence that combining entity-level and hyperedge-level retrieval is beneficial. These results suggest practical potential for structured multimodal retrieval.
Critical weaknesses
1. Insufficient evidence for the necessity and effectiveness of the proposed hypergraph representation.
The central claim of the paper is that higher-order multimodal hypergraph representations provide advantages over conventional chunk-based and graph-based retrieval. However, the experiments do not sufficiently isolate the contribution of the hypergraph structure itself. DocHyper combines LLM-based multimodal semantic extraction, entity and hyperedge indexing, dual-path retrieval, and source-page grounding. Importantly, the final answer generator primarily receives retrieved page images rather than explicit hypergraph evidence.
Although Table 2 includes graph-structure ablations, these experiments do not rule out the possibility that a simpler retrieval system using the same extracted entities and semantic descriptions, but without hypergraph connections, could achieve comparable performance. Moreover, cross-element hyperedges are constructed primarily through same-page heterogeneous entity grouping, which does not necessarily capture meaningful higher-order semantic relationships.
Consequently, the reported improvements do not convincingly establish that the proposed hypergraph representation is necessary, rather than the gains arising from richer semantic indexing and improved page selection. This substantially weakens the paper's central technical contribution.
2. Inadequate evaluation against recent SOTA retrieval methods, modern VLMs, and agentic approaches.
The empirical evaluation is insufficient for establishing the significance and competitiveness of the proposed method.
First, two highly relevant and formally published methods, HippoRAG 2 (ICML 2025) and HyperGraphRAG (NeurIPS 2025), are relegated to the appendix. In particular, HyperGraphRAG is conceptually close to DocHyper and should receive a more thorough and controlled comparison. The existing comparison also involves different answer-generation contexts, making it difficult to attribute the performance gap specifically to the proposed representation.
Second, all main retrieval experiments rely on Qwen2-VL-7B-Instruct, a relatively outdated VLM released in 2024. More recent models, such as Qwen3-VL, offer substantially stronger multimodal understanding capabilities. It remains unclear whether the proposed retrieval improvements persist when stronger VLMs are used as the answer-generation backbone.
Third, the paper lacks comparisons with recent long-document VLM/agent systems, such as DocAgent (EMNLP 2025) and MM-Doc-R1 (Findings of ACL 2026). Given that modern VLMs and tool-using agents can directly process long multimodal documents, it remains unclear whether constructing a hypergraph index provides any accuracy advantage over such alternatives.
Questions for authors
-
In the graph-structure ablation in Table 2, are the extracted semantic contents, embeddings, retrieval budgets, and final QA contexts kept identical when replacing hyperedges with pairwise edges? What specific component of the performance improvement can be attributed exclusively to higher-order hypergraph connectivity?
-
Can the authors compare DocHyper against a simpler dual-index retrieval baseline that uses exactly the same extracted entities, multimodal semantic descriptions, and source-page images, but does not construct or traverse hypergraph connections? Additionally, how much performance is lost when cross-element hyperedges are removed? These results would be important for establishing the necessity of the proposed representation.
-
Do the reported improvements persist when using a modern VLM, such as Qwen3-VL-8B, as the shared answer generator for DocHyper and representative retrieval baselines? How does DocHyper compare with recent VLM-based document agents under comparable evaluation protocols, particularly in terms of answer accuracy?