- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces DuoState, a benchmark of 30 scenes with two characters and four instruction branches for evaluating selective state control in video generation. The authors also propose a judge that combines regional visual evidence, VLM observations, a state ledger, and temporal rules. Experiments evaluate four video generation models and compare the judge with direct assessment of full frames.
Critical strengths
The paper aims to study a worthwhile problem: changing the states of selected people while preserving the states of others. This is an good aspect of video controllability that identity consistency alone cannot fully capture.
Critical weaknesses
- Limited benchmark contribution. Selective state control is a general problem, yet DuoState reduces it to only 30 scenes involving exactly two people and a rigid four branch protocol. The paper does not establish why this narrow design is necessary or representative of state control in video generation. The reversal branch also requires occlusion, although it is unclear why occlusion should be necessary for evaluating state restoration. The paper does not clearly specify whether the provided images are used as reference images or first frames. However, the model input configurations and qualitative results suggest that they serve as first frames. These images are constructed by concatenating two separately generated portraits, which is very likely to introduce unnatural spatial relationships and inconsistent backgrounds, potentially interfering with the evaluation.
- Unclear novelty, unfair comparisons, and room for improvement in presentation. Related benchmarks such as OSCBench (Han et al., ACL 2026) and TC-Bench (Feng et al., ACL 2025 Findings) already evaluate state changes and temporal transitions, but are not discussed. The additional value of DuoState is unclear. Model comparisons are also confounded by different generation settings. The readability is relatively poor. For example, Excessive tags and data details like index number in Figure 2 and 4 make them difficult to read.
Questions for authors
- Why is selective state control restricted to two characters and four fixed branches, and why is occlusion required for reversal? These constraints seem unnecessarily restrictive for evaluating a general state control capability.
- Are the concatenated character images used as reference images or first frames? The authors should rule out potential interference from unnatural spatial relationships and inconsistent backgrounds, which may confound the evaluation of state control.
- What additional evaluation capabilities does DuoState provide beyond OSCBench (ACL 2026) and TC-Bench (ACL 2025 Findings)? The overlap with existing benchmarks and the inconsistent generation settings make it difficult to assess the significance of the reported results.