- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper trains a multimodal memory-access policy through state-level on-policy self-distillation. Reference-based sufficiency and gap diagnoses guide a privileged teacher at student-visited states. The framework combines retrieval tools, compact short-term memory, and the synthetic MemVista dataset. Evaluation on Mem-Gallery and MemEye measures answer quality, evidence recall, and retrieval cost.
Critical strengths
Supervision is reconstructed at student-visited states, allowing teacher feedback to reflect the evidence currently available. The empirical efficiency gain is substantial: on Mem-Gallery, OPSD achieves 79.74% full evidence recall with 2.89 actions, versus 78.49% with 6.03 actions for GRPO.
Critical weaknesses
-
Sufficiency labels may encode completeness information unavailable to the student. In exhaustive image search, identical observations and search history can correspond to a complete two-image set or an undiscovered third image. The reference answer distinguishes these cases and determines whether the teacher must STOP, potentially assigning opposing stopping targets to observationally identical states.
-
The ablations conflate better stopping with better retrieval choices. With STM retained, dynamic PI improves Mem-Gallery accuracy by 1.40 percentage points while reducing actions by 32.9%, also consistent with gains driven mainly by termination. The reference-trajectory comparison changes both feedback content and format, while final evidence recall reflects retrieval choices and stopping jointly.
-
STM retains at most 24 events, and only the final STM reaches the answer model. Queries requiring image IDs from more than 24 independently necessary events would exceed this capacity unless information survives eviction elsewhere. Below capacity, rank fusion may still discard low-ranked corrections or bridging facts in favor of relevant but redundant events.
Questions for authors
How often do sufficiency labels depend on completeness information that cannot be inferred from the public state?
Can sufficiency-only supervision match full PI in evidence gained per non-STOP action?
Can evicted evidence survive elsewhere, and how often does STM consolidation remove necessary supporting events?