- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduce EgoCITE, a situation-aware framework that contextualizes both memory storage and retrieval for long-horizon egocentric question answering and evaluate EgoCITE on EgoLifeQA, EgoMem, and EgoR1-Bench using answer accuracy and target-event retrieval alignment. Across the three benchmarks, EgoCITE improves average answer accuracy over the strongest agentic memory baselines by 4.4–14.2% while achieving 36×lower normalized cost than long-context LLM agents.
Critical strengths
S1: The framework is clear and useful. The four-stage pipeline is well-designed with clean module decoupling, EgoScheme handles context resolution, EgoIndex handles multi-view organization, and EgoRetrv handles temporal ranking. S2: Evaluation is solid, three benchmarks and multiple baselines are evaluated. EgoCITE-GPT achieves hit rate improvements of 15.1/17.0/22.7% on the three benchmarks. The efficiency is considered, The 36× cost reduction vs. long-context agents, combined with higher accuracy, provides clear evidence of a Pareto-optimal trade-off across accuracy, latency, and cost.
Critical weaknesses
W1: The method seems to have limited algorithmic novelty. All core components are combinations of known techniques. Eq. (1) is essentially simple exponential decay, λ=0.99 is close to "equals 1," and the contribution of temporal scoring may be overstated. W2: The method depends heavily on prompt engineering. EgoScheme, EgoIndex, and EgoRetrv all rely heavily on the prompt execution quality of GPT-5.4. And the prompt is complicated, contains rules, definitions, examples, etc., which seems more like a few-shot + rule-based prompting. This may means this is a victory of prompt design rather than methodological contribution. W3: The cost comparison is unfair. The GPT-5.4 agent baseline processes raw JSON documents directly, while EgoCITE uses preprocessed atomic indices + curated pool. The two systems' costs are not computed on the same baseline, since the preprocessing cost of EgoCITE is ignored.
Questions for authors
- Whether the cost comparison is accounting for preprocessing. The 36× cost advantage compares the "GPT-5.4 agent baseline" processing raw JSON against EgoCITE-GPT consuming pre-generated atomic indice. If the offline indexing cost is amortized into EgoCITE's per-query cost, what is the actual cost ratio?
- W2
3 comments
The review comments were originally written by the reviewer and polished by an AI tool.
Thanks for the response and additional experiments, but I still intend to maintain my original score. I expect a explanation more theoretically and explainable.
We thank the reviewer for the insightful comments. Below, we address each concern in turn.
W1: Novelty and temporal scoring
We agree the building blocks are established and do not claim them individually. Our contribution is the finding that semantically similar evidence is not necessarily situationally relevant (Appx. A), and a design in which each component addresses one resulting failure. Tab. 10 shows the progression on EgoR1-Bench: accuracy 61.3% → 69.7% (+EgoScheme) → 69.7% (+EgoIndex) → 75.3% (+EgoRetrv), and hit rate 40.7% → 55.7% → 59.3% → 62.7%.
Eq. (1) is deliberately simple. What is new is that the time query Q_t is estimated from the question's temporal intent and used as a ranking signal rather than a hard filter. Unlike recency scoring, which decays with the time elapsed since the present, Eq. (1) decays with the distance to Q_t. λ = 0.99 is applied per hour over a 56-hour timeline, so the weight spans 1 to ≈ 0.57. Because top-candidate similarities are tightly clustered (ranks 1 and 24 differ by 0.16 in Fig. 14), this moves the target-overlapping index from rank 24 to 4, 21 to 4, and 26 to 8 (Figs. 14–16). Tab. 10 and Tab. 11 quantify its contribution on EgoR1-Bench: adding EgoRetrv raises accuracy from 69.7% to 75.3% and hit rate from 59.3% to 62.7%, and removing only the decay (λ = 1) lowers accuracy from 75.3% to 74.3% and hit rate from 62.7% to 61.0%.
W2 / Q2: Prompt engineering
We do not propose a sophisticated memory architecture. Instead, we reveal that as long as a human-centered memory is situation-aware, it gains 14.0% in accuracy over caption RAG (61.3% → 75.3% on EgoR1-Bench, Tab. 10), despite using the simplest vector database. Its methodological contribution lies in two findings revealed by our results:
Both findings hold across models: the GPT-based memory baselines use the same GPT-5.4 retrieval and answering backbone as EgoCITE-GPT, and a fully open-weight pipeline without GPT-5.4 still reaches 57.1% on EgoLifeQA (Tab. 15), vs. 49.6% for WorldMM-GPT.
W3 / Q1: Cost comparison
The 36× figure compares per-question cost only (3.979 dollars vs. 0.110 dollars, Tab. 13). Both systems start from the same multimodal captions; EgoCITE additionally builds the index. The indexing cost is 0.018 dollars per minute of recording (new Tab. 14). Indexing one participant's 56-hour recording therefore costs ≈ 60.5 dollars once (3,360 min × 0.018 dollars), i.e., ≈ 0.125 dollars per question on EgoLifeQA (≈ 484 questions per participant). Including it, EgoCITE-GPT costs 0.235 dollars per question, ≈ 17× cheaper than the GPT-5.4 agent (≈ 25× with one round). The indexing cost of all methods is reported in the revision (Tab. 14).