- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper propose StreamingMEM-R1, a framework that jointly learns memory evolution, evidence routing, and response timing to address the challenges of tracking evolving events and coordinate evidence retention with response decisions. Experiments have demonstrated the effectiveness of the proposed method.
Critical strengths
- The paper introduces memory operation and memory routing to logically decouple memory maintenance from question-answering behavior, while enabling joint optimization over complete trajectories.
- Extensive experiments demonstrate the superior performance of the proposed method.
Critical weaknesses
- StreamingMEM-R1 uses the same video sources and annotations as ThinkStream. However, it remains unclear that whether the performance improvements from the proposed evolution of Stable/Dynamic Memory, higher-quality teacher-generated trajectories, or additional training and verification procedures.
- The paper only evaluates performance on downstream tasks without directly assessing the quality of the learned memory, such as memory correctness and memory update error rates.
Questions for authors
- Could you further discuss the primary sources of the performance improvements and clarify how much each component contributes to the overall gains?
- Could you provide a separate evaluation of the generated memory?
3 comments
Thank you for author's response. I have no concerns and decide to keep the positive score.
Dear Reviewer BP1U
We sincerely appreciate your positive feedback. We are pleased that our response has addressed your concerns, and we are grateful for your recognition and support of our work.
Best regards,
Authors
Response to Reviewer BP1U
Response to Sources of Performance Gains
Sharing video sources and base annotations with ThinkStream does not imply identical supervision or training. StreamingMEM-R1 combines trajectory construction, explicit memory management, and trajectory optimization; we do not attribute all gains to the stable/dynamic memory split alone.
Unlike ThinkStream's compressed reasoning memory, our causal trajectories explicitly encode stable and dynamic memory states, memory operations, answer routing, and response decisions. We filter them for visual grounding, causality, and state consistency. Streaming-aware SFT learns these structured decisions, while memory-oriented RLVR jointly optimizes subsequent behavior using the model's own generated memory.
Ablations using the same training corpus show that the gains cannot be explained solely by changing teacher-generated trajectories:
We also added a FIFO baseline with matched recent visual context, semantic history, and historical replay access:
Additional reward ablations further separate the effects of the training objectives:
Together, these results support complementary contributions from memory supervision, context maintenance, cache management, and trajectory optimization. They support the full framework.
Response to Direct Memory-Quality Evaluation
We used GPT-6 Astra to evaluate model-generated memory directly:
We define factual accuracy as the fraction of generated atomic facts supported by causally visible video evidence. The memory-update error rate is the fraction of executed update steps containing at least one update error.
Dynamic memory is slightly more accurate, consistent with recent frames directly supporting ongoing actions and states. Stable memory requires compression across chunks, which may lose precise text, attributes, or event details. The lower accuracy on OVO-Bench may reflect its more demanding historical reasoning, including past locations, action order, and insufficient-evidence judgments. These measurements provide direct evidence of memory quality while also identifying remaining update errors.