- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Camera Scene Grammars (CSG) for assessing semantic reliability in fixed-view surveillance using earlier observations from the same camera, without a contemporaneous clean reference. The method constructs persistent anchors, class-conditioned occupancy statistics, track-continuation models, and relation contexts. It produces separate evidence channels for missing content, unsupported observations, and inadmissible relations, together with coverage masks.
Critical strengths
-
The formulation is well structured and useful. The paper moves beyond scalar quality prediction by introducing typed object-level evidence, expected-node slots, and explicit coverage.
-
The experiments are thoughtfully designed. The evaluation includes matched-history baselines, swapped and spatially permuted grammars, alignment controls, and component ablations, rather than relying only on comparisons with history-free quality models (Table 3 and Appendix E).
Critical weaknesses
-
The selective-decision advantage is not sufficiently supported at matched coverage. Appendix H mentions a matched-retained-coverage comparison, but the corresponding results are not shown. Table 9 reports a 6.1% unresolved fraction for CSG and none for the listed baselines, leaving unclear whether CSG’s lower false-rejection rate reflects better discrimination or differences in abstention. Please report false-rejection rates and error-detection performance at the same retained coverage.
-
The independence of the downstream evaluation models is unclear. Section 5.1 cites Zhao et al. (2024) for the evaluation detector, while Appendix L includes RT-DETR in the ensemble and states that evaluation models come from outside the ensemble’s model families. Please specify the detector, tracker, and checkpoints used in Tables 2 and 5, and clarify their relationship to the ensemble. This would establish whether the results support the claimed applicability to model families outside the ensemble.
Questions for authors
-
Does CSG retain its advantage over the confidence/track and history-standardized baselines at the same retained coverage? What are the false-rejection rates and error-detection performance under this comparison?
-
What are the evaluation units and denominators for the rates in Table 9? How many events or candidate observations are included in the 36 clips, and how are they distributed across challenge categories?
-
Which detector, tracker, and checkpoints are used in Tables 2 and 5? Are their model families represented in the ensemble?
Thank you for the detailed response and revisions. The clarifications and additional experiments have addressed most of my concerns and strengthened the empirical support for the paper. I therefore raise my rating from Weak rejection to Weak acceptance.