- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
VideoSpy, a video-understanding agent equipped with three visual tools. A Reflector uses fixed training trajectories and ground-truth references to extract and review textual Skills and Memory, which are subsequently incorporated into the agent’s inference context. The resulting state is frozen before evaluation.
Critical strengths
- well-written.
- a novel method (self-evolving agent) in video understanding agent.
Critical weaknesses
-
insufficient baseline, only DVDAgent, WorldMM, and VideoSeek, but there are many agent systems in video understanding tasks from my view, also there are many techs in this domain, for example we would like to see 0-shot (direct answer), few-shot learning.
-
the concern of generalization, the training data is sampled from the test data, they are in the same distribution. We would like to see a strict training and test split. For example, you can only use one of your benchmarks as the training data and test in the other benchmarks.
-
meanwhile, the method like the reflection and self-evolving are popular in coding agent or deepresearch agent, i do not find any special in this paper, it just applied the method in the video understanding demain, and the memory is the textual memory. From my view, there should be something different in video tasks, like non-textual memory.
-
for the memory management, the paper does not mention that how to maintain the memory when explosion, and how to merge or delete memory. and for the retrieval machenism, it just uses the semantic similarity, but in agentic tasks, the semantic similarity is not equivalent to beharvioural memory.
Questions for authors
-
How does VideoSpy compare with a direct-video baseline using the same backbone on LVBench and EgoLifeQA, under comparable visual-input and inference budgets?
-
Under the same training trajectories and agent harness, how much does the proposed reflection-and-review procedure improve over direct retrieval of successful trajectories or a single-pass summary of experience?
-
Is there evidence that frozen Skills transfer to another dataset or an unseen task type, without further evolution? Such evidence would materially strengthen the generalization claim.