- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
LASER addresses object-conditioned state readout in videos using a frozen multimodal model. Structured observation skills guide attribute inspection; hypotheses about future changes select discriminative attributes to reinspect in the current frame. Independent observations of subsequent frames support correction, and reference-based feedback revises reusable skills on training videos. Evaluation on OSCaR and PLM RCap uses four model backbones and compares prompting, reinspection, skill-optimization, and existing agent baselines.
Critical strengths
-
Using anticipation to select current visual attributes is a meaningful observation principle. It targets the tendency of generic captioning to describe object categories or activities while missing attributes that distinguish state transitions. The workflow is interpretable and has practical benefits over direct captioning: with Qwen3.5-9B, OSCaR ROUGE-L increases from 26.9 to 29.6 and the PLM RCap score from 25.6 to 28.1. Evaluation across four backbones and two datasets provides useful breadth.
-
The separation of observation from anticipation is thoughtful. Initial observations are obtained without the predictions, and later visual evidence can correct the hypotheses. Table 3 supports the importance of this separation: removing independent observation reduces Qwen3.5-9B scores from 29.6 to 29.0 on OSCaR and from 28.1 to 27.3 on PLM RCap. This is separation of prompt inputs and information flow, rather than independence of the underlying visual models.
Critical weaknesses
-
Limited methodological novelty. The contribution mainly combines structured prompting, sequential verification, and prompt optimization. Anticipation-guided attribute selection is a sensible task-level design, but its distinctive observation capability beyond these existing mechanisms is not sufficiently demonstrated.
-
Unclear attribution and computational fairness. Without skill revision, 4B LASER ties Attribute Checklist on OSCaR (26.7) and trails it on PLM RCap (25.9 versus 26.8). The independent benefit of anticipation remains unclear, and missing call/token/latency accounting makes it difficult to separate design gains from extra computation.
-
Weak evidence for the specialized revision procedure. GEPA on the same LASER interfaces exceeds Full on OSCaR ROUGE-L for three of four backbones and on PLM RCap for two. Some gains over existing systems are also small, such as 29.6 versus 29.4 for ScaleCap. The added value of specialized revision is not established.
-
Indirect evidence for factual state accuracy. Caption-reference similarity does not directly establish correct attributes or transitions. The revision-stage contradiction check is not a test-set factual evaluation, especially for details absent from references. The claimed improvement in object-state understanding needs direct support.
Questions for authors
-
Does anticipation provide an independent benefit in a two-by-two comparison with skill revision on/off, while retaining visual correction?
-
How do LASER and simpler reinspection/checklist baselines compare at matched model-call, visual-input, and token budgets? Please report their inference latency.
-
What benefit does the specialized skill revision provide over GEPA on the same interfaces and at matched adaptation budgets?
-
Does LASER improve test-set attribute and transition accuracy and reduce unsupported claims, including details absent from reference captions?