- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the write side of embodied multimodal memory. The authors argue that many memory architectures focus on indexing and retrieving stored information while paying less attention to what information is available when a memory record is written.
The paper formalizes a memory access structure as a write map and an address algebra, and proposes a capability decomposition involving event identity, ordinal addressing, and perceptual reading. It also discusses limitations of single-frame writing for recognizing time-reversed actions, and the effect of detection errors on ordinal queries.
Based on this analysis, the authors introduce AXIS, which uses ordered frame pairs, object status differences, event occurrence records, and explicit address execution. Experiments on EPIC-KITCHENS streams and TempCompass evaluate the write rules. The end-to-end experiments show that the proposed system does not achieve the expected improvements, while an oracle ledger gives substantially better results. The paper reports these negative findings and uses them to identify remaining limitations in event detection.
Critical strengths
-
The paper raises an interesting question about what information is lost at memory writing time. The distinction between recording an object state and identifying a transition is useful, particularly for temporal and ordinal queries. I also appreciate the attempt to connect the write representation with the types of addresses that can be executed later.
-
The experimental analysis is unusually careful about negative results. The authors include duplicate-frame and reversed-frame controls, which help show that the initial improvement from ordered pairs cannot be attributed to temporal information alone. The paper also reports failed registered predictions rather than hiding them. The oracle-ledger experiment is another useful control: on the conjunctive task, replacing the model-written ledger with an annotation-based ledger improves accuracy from 18.8% to 31.5%. This gives evidence that the written event representation is a major limitation of the evaluated system.
Critical weaknesses
-
I have concerns about the scope and correctness of several theoretical claims. The identity wall is valid for a frame-local emission under its stated symmetry assumptions, but a memory system can store single-frame statuses and compare them later to recover transitions. The paper acknowledges this possibility, yet the broader claim that the address algebra cannot be richer than the write still needs a more precise definition of what information the write representation contains. The product capability bound also relies on an assumption about the accuracy after the address chain fails. This assumption is discussed in Appendix B.2, but it would be better to state it explicitly together with Proposition 1. More concretely, the final claim of Proposition 8 about the recall of the union of two detectors appears incorrect without an additional assumption on their error dependence. The stated upper bound holds under independent or positively correlated misses, but can be violated when the misses are negatively correlated. Since the theoretical framework is a main contribution, these issues matter considerably.
-
The experiments do not yet provide strong support for the proposed architectural solution. On gemma-3-12b, the duplicate-frame control achieves higher verb accuracy than the ordered pair under the original prompt, suggesting that the improvement cannot be attributed to temporal information alone. The positive result with one-second frame spacing is mainly observed on Qwen3.8-27B and does not transfer consistently to the other backbones. Also, the reported 82.7% direction accuracy is calculated only on gold put/take frames where the model itself predicts put or take. This conditional evaluation should be interpreted together with coverage and a majority baseline computed on the same subset. At the end-to-end level, AXIS remains close to its controls. The oracle ledger helps, but this supports the diagnosis of the bottleneck more than the effectiveness of the proposed method.
Questions for authors
-
Can the authors clarify the exact distinction between information available to the write emission and information recoverable from the complete memory record? In particular, does the proposed constraint on the address algebra still hold when a system stores an ordered sequence of single-frame states and derives events at read time? I think this is important for evaluating the generality of the theoretical contribution.
-
Can the authors clarify the assumptions behind the detector-union recall bound in Proposition 8? The stated inequality appears to require independent or non-negatively correlated miss events. Without this assumption, detectors with complementary misses can achieve a higher union recall than the proposed bound. The authors should either state the required assumption or revise the bound.
-
For the one-second spacing result, can the authors report direction accuracy and coverage on the complete set of gold put/take frames, along with a comparison on the same subset of examples across conditions? It would also help to compare against a system that writes single-frame object statuses and performs deterministic temporal differencing afterward, without requiring an ordered pair as model input.