- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how to build persistent visual memory for smart-glass assistants under limited storage. Its central observation is that egocentric video contains substantial redundancy across hours and days because users repeatedly encounter the same environments and objects. The proposed system combines a multi-rate neural codec, a novelty-aware rate selector that preserves unfamiliar observations at higher quality, and a memory-guided diffusion decoder that reconstructs heavily compressed frames using previously stored reference images. It retains a compressed representation of every sampled frame to support unforeseen future questions. The authors also introduce EgoCompress, a benchmark targeting fine-grained visual attributes in seven days of egocentric recordings. Experiments across four egocentric question-answering benchmarks report substantial storage savings while preserving downstream accuracy.
Critical strengths
-
The paper addresses a practical challenge in storing visual experiences for questions that are unknown at recording time.
-
The evaluation measures whether compressed memories remain useful for answering questions, including fine details through the new EgoCompress benchmark.
Critical weaknesses
-
There is a placeholder/hallucinated citation in the paper. Line 152-153 mentions cites Memorize-and-recall but its citation is simply a placeholder.
-
A few baselines are missed by the paper. The authors should at least discuss why they are not compared.
- StableCodec: Taming One-Step Diffusion for Extreme Image Compression
- DLF: Extreme Image Compression with Dual-generative Latent Fusion
-
The generative decoder restores details using older reference images. If an object’s label, location, or state has changed, it could introduce outdated or invented details. The metrics used in the paper (accuracy and perceptual similarity) do not directly measure these false memories, especially problematic when preserving evidence for unforeseen questions is the central motivation. To strength the paper, the author could add controlled tests where the current observation differs subtly from references, measuring errors in text, object presence, counts, and state changes.
-
Section 3.1 explicitly assumes the target frame is known. Thus, the experiments test reconstruction and answering after evidence selection; they do not establish whether an assistant can locate the right observation within a growing archive. The main multi-day benchmark also covers only one person over seven days, and the paper reports no archive-scale retrieval or query-latency results.
Questions for authors
See weakness.