- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
TeleHyperVis-RAG is a Retrieval-augmented generation (RAG) framework designed for multimodal question answering in the telecommunications domain. It constructs a multimodal knowledge base covering areas such as 5G/6G, satellite communications, cybersecurity, and IoT. For hypergraph retrieval, it employs an entity-hyperedge dual-indexing scheme combined with BFS-based neighborhood expansion. Its engineering aspects appear sound, but the paper has some issues with writing and presentation.
Critical strengths
- As a domain-specific work, it provides evidence that RAG can indeed enhance LLM performance on telecom tasks.
Critical weaknesses
-
A major concern is the lack of comparisons with methods accepted in 2026 or recent preprints. The paper cites 2026 work such as RFSensingGPT and MG-RAG, but the experimental baselines are still LightRAG, GraphRAG, HyperGraphRAG, and BiGraph-RAG. Without direct comparisons with newer methods, the results do not support a claim of outperforming the latest work from 2026.
-
The same five QA benchmarks are used for both evaluation and parameter sensitivity analysis, with no separate development set, as the authors state in Section 4.3. Choosing parameters on a separate in-domain or even out-of-domain development set and then evaluating on these five benchmarks would provide stronger evidence of generalization. With the current setup, I am unsure how to choose the hyperparameters for a new benchmark. Should the reported settings simply be reused?
-
The figures are difficult to read. The text in Figures 2 and 3 is barely legible even when I zoom in, and it would be harder still for readers using a printed copy. I have tried to read them carefully, but please bear with me if I have misunderstood any details because of this. Figure 4 is particularly important for the ablation study, yet it is also very difficult to follow. The legend in the upper-right corner does not seem to match the discussion in the text, or at least the connection is unclear. If I am reading it correctly, the orange dashed line labeled GPT-5.2 represents the setting with no external knowledge. Why does it outperform the setting using 3GPP and arXiv? This seems to suggest that adding the proposed data actually hurts performance. An unexpected result like this deserves an explanation in the text. Please also consider using vector figures, such as SVG or PDF, so readers can zoom in and follow the concepts more easily.
Questions for authors
Please see the weaknesses above. I also have the following concerns and questions.
-
The benefit of the visual component seems limited, with relatively modest gains over HyperGraphRAG. TeleHyperVis-RAG has several modules, but the ablation study appears to remove only the hypergraph component. This leaves the contribution of the other modules unclear. Could the authors test these modules separately to show which ones account for the gains?
-
The method also has a substantial latency cost, which varies by task. On TeleTable, the average time is 50.54 seconds, compared with 19.89 seconds for HyperGraphRAG. On TeleMATH, it takes 14.12 seconds, compared with 9.84 seconds. Could the authors explain the additional latency and discuss whether the accuracy gains justify it, particularly for applications where response time matters?
-
MultiHyper-RAG is mentioned only once. Could the authors clarify where its results are reported?
8 comments
Response to Critical Weakness 2: No separate development set; hyperparameter generalization concerns
We thank the reviewer for this important methodological point. We clarify the nature of our parameter analysis and provide practical guidance for new benchmarks: Our parameter analysis in Section 4.3 is explicitly framed as post-hoc sensitivity observation, not as hyperparameter optimization on the test set. The final reported configuration is not selected by maximizing test accuracy; instead, the default settings are determined based on telecom domain priors and empirical experience, and applied uniformly across all five benchmarks. Guidance for new benchmarks: Given the scarcity of public multimodal telecom RAG benchmarks, we provide a unified default parameter setting for direct reuse: • For text-only QA tasks: Entity K=3, Relation K=3, BFS depth=2, Final K=12 • For multimodal / structured reasoning tasks: Entity K=3, Relation K=3, BFS depth=1, Final K=10 The main difference lies in BFS depth, as multimodal tasks are more sensitive to redundant context introduced by deep expansion. The stable performance of this default configuration across five independent benchmarks demonstrates its cross-task generalizability. We further conducted sensitivity analysis on these hyperparameters: within a reasonable perturbation range (±1 for K values, ±1 for BFS depth), the overall accuracy does not drop sharply, which further corroborates the robustness of our method to parameter settings.
Response to Critical Weakness 3: Poor figure readability; confusing Figure 4 legend and counterintuitive results
We apologize for the poor readability of the figures and the confusion caused by Figure 4. We have made the following revisions: • Figure quality improvement: We have adjusted the layout and enlarged font sizes for Figures 2 and 3 to improve readability. All result figures will be provided in vector format (SVG/PDF) in the final version to support lossless zooming and printed reading. We note that the diagrams fed to the VLM use compressed formats for transmission efficiency, which is separate from manuscript figure quality. We have verified that this compressed format fully preserves all hypergraph topological relations and entity label information without information loss, ensuring the integrity of structural input for the model. • Figure 4 legend correction: We have corrected the legend of Figure 4 to fully align with the textual description, and adjusted line styles for clearer visual distinction. • Explanation of the counterintuitive no-external-knowledge result: The observation that the base LLM outperforms the 3GPP+arXiv configuration on some subsets is a well-documented boundary effect of retrieval-augmented generation. This phenomenon only occurs on simple factual questions that are already well covered by the LLM's parametric knowledge, where retrieved text introduces irrelevant noise and distracts the model. On complex multi-entity reasoning, standard clause association, and structured table tasks—the core focus of our work—retrieval-augmented configurations consistently and significantly outperform the base LLM. This result defines the applicable boundary of our method rather than negating its value.
Response to Critical Weakness 1: Lack of comparisons with 2026 methods
We fully agree that comparison with recent state-of-the-art methods is essential, and we have supplemented relevant comparisons in the revised manuscript: • Clarification on RFSensingGPT: RFSensingGPT (Khan et al., 2026) is a framework targeting radio frequency (RF) sensing scenarios, with a focus on signal perception and edge intelligence. In contrast, our work and the Telco-RAG baseline focus on telecom standard knowledge question answering, covering broader subdomains including 5G/6G core networks, network security, and IoT. The two works address different task paradigms and application scenarios, so they are not directly comparable as peer baselines. • Added comparison with MG²-RAG: We have supplemented experimental comparison with MG²-RAG (Dai et al., 2026), a representative 2026 work on multi-granularity graph multimodal RAG that is most methodologically relevant to our work. Results on TeleQnA and ORAN-Bench benchmarks show that TeleHyperVis-RAG achieves higher accuracy, demonstrating the advantage of hypergraph higher-order retrieval combined with multi-view visualization. We have also enhanced the related work section to explicitly elaborate the differences between our method and recent 2026 works, highlighting our unique contribution in higher-order relational encoding and semantically aligned visualization for telecom QA.