- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors proposes OmniMemory to retain the raw audio into the memory through three mechanisms. Progressive Memory Construction helps to associate the context with entity, Retrospective Consolidation & Auditing enables stored memories to be revisited and revised and Query-Aware Memory Routing makes the revisit process more efficient. Experiment on different benchmarks shows it gets a good result.
Critical strengths
- It retains the raw audio and processes it to make it more efficient during the retrieval.
Critical weaknesses
-
It looks like these three mechanisms appear to overlap with the previous work. M3-Agent also builds the identity of audio, WorldMM also revisits the memory, HippoMM also retrieves the memory in different hierarchies. The author didn’t differentiate their contribution with previous work clearly.
-
HippoMM also keeps the raw audiovisual data for retrieval.
-
Experiment on Table 1 shows that only one training free baseline method gets improved over the base model, which implies that training free method may be sensitive to the base model. The authors only evaluates their method with a single base model, leaving it unclear whether the reported improvements generalize to other models, such as Gemini 3.1 Pro.
-
Progressive Memory Construction helps to build the connection between identity and information. However, OmniMemory didn’t outperform Video-RAG on personal understanding.
Questions for authors
What gap in prior work does this work address?