- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents IntervalRAG, a temporal retrieval-augmented generation framework that represents persistent states or phases as Macro-Interval Units (MIUs) and events or transitions as Micro-Event Units (MEUs). It builds hierarchical links between the two unit types and local temporal edges among events. At inference time, the system retrieves and reranks macro-level candidates, expands them through bounded temporal graph traversal, and supplies the resulting event evidence together with selected source passages to LLMs. The authors also conduct some experiments and ablation studies to show the effectiveness of the porposed algorithm.
Critical strengths
- The paper targets an important temporal QA limitation: point-event retrieval can miss persistent states and the transitions that delimit them.
- The MIU–MEU representation, interval-aware retrieval, and local graph traversal form a coherent end-to-end pipeline, supported by useful ablations and stage-wise retrieval diagnostics.
- The experiments report high answer-inclusion accuracy on TempReason and ComplexTR and include both an extraction-quality audit and an efficiency analysis.
Critical weaknesses
- The paper seems only have incremental novelty. MIUs provide a useful state-oriented formulation, but interval-valued event/state representations and hierarchical temporal retrieval are already present in related work (IA-RAG models interval events and hierarchical thematic units with interval-algebra-guided retrieval, while DyG-RAG already concatenates semantic and Fourier time features in its retrieval embeddings.)
- It is unclear whether the comparison with the baseline methods are reasonable. More specifically, it may be hard to tell whether the better performance of the propose method is becuase of the framework or merely just because more context is return to LLM generation stage. Also, although table 3 shows the comparison to graph-free baselines, the IntervalRAG seems also brings some addition event information so making it unfair in terms of the retrieval constraints.
- It may need to futher explanation for the experiment results. The Acc_full metric does not penalize extra incorrect or contradictory claims. The supplementary short-answer results also show metric sensitivity: on TimeQA, IntervalRAG’s EM is 27.67%, compared with 28.17% for DyG-RAG, despite the higher answer-inclusion score. The paper should foreground a stricter answer-level metric or human correctness audit and explain how Acc_full relates to established inclusion-based accuracy. A more reasonable evaluation should include validation of the entity, time and relations.
- The offline indexing cost is unclear. It seems the paper describes separate LLM extraction passes for macro intervals and micro events, yet does not report actual per-chunk or per-query request counts, input/output tokens, monetary cost, or the extra query cost of anchor-event recovery.
- It is unclear what will be the cost of updating the information in the proposed framework.
Questions for authors
- How sensitive are the results to key search hyperparameters—particularly the 2,000-vector candidate pool, 20 macro seeds, traversal limits, and two-chunk passage budget—and were these values selected using validation data?
- How does macro–micro linking handle events that span multiple chunks, conflicting intervals, or gaps in source evidence, and has this behavior been audited on manually labeled examples?