- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GovLA-10K, a management-oriented aerial benchmark containing 10,572 images, bounding-box annotations for nine categories, and captions comprising scene descriptions and management recommendations. It also proposes GovLA-Reasoner, which connects a task-adapted grounding detector with a frozen language model through a Spatially-aware Grounding Adapter (SGA). SGA compresses and integrates image, query, and decoder features to support caption generation. Experiments on GovLA-10K include captioning comparisons, expert assessment, adapter efficiency measurements, and architectural ablations.
Critical strengths
- The benchmark addresses a practically relevant problem. GovLA-10K combines aerial localization, contextual descriptions, and management recommendations, extending evaluation beyond conventional object detection. Expert review of the generated annotations is a useful quality-control step.
- The framework is coherent and supported by initial experimental evidence. Tables 2–4 examine adapter cost, fusion depth, and feature-stream contributions, while Table 1 supplements automatic metrics with expert assessment. Freezing the detector and LLM during Stage II provides a practical adaptation strategy.
Critical weaknesses
-
The evaluation does not adequately establish the reliability of management-risk assessment. BLEU, METEOR, ROUGE-L, and CIDEr measure agreement with reference captions, while the expert evaluation in Appendix C does not specify a detailed rubric separating factual grounding, risk-identification accuracy, and recommendation appropriateness. Moreover, Appendix A lists construction workers, fencing, and scaffolding as “violation categories” without explaining how compliant or ambiguous cases are distinguished, leaving open whether the benchmark rewards category-triggered recommendations rather than contextual risk reasoning.
-
The adapter comparisons are too limited to establish SGA’s architectural advantage. Table 2 compares SGA only with LLaVA-Projector (2023) and Q-Former (2023), without evaluating more recent, task-relevant adapters or token-resampling mechanisms. Since these baselines are also marked as lacking multi-stream integration, the experiment does not clearly separate the benefit of SGA’s design from access to additional grounding features.
-
The claimed benefit of implicit coordination is not directly validated. Although Figure 4 contrasts SGA with an explicit detector–VLM pipeline, the experiments do not identify a controlled comparison using the same detector predictions, images, and structured prompts. Tables 3–4 provide quantitative ablations, but Appendix E’s full-model qualitative comparison does not show how SGA’s compression and fusion preserve spatial evidence or reduce the claimed information loss and error propagation.
Questions for authors
-
What instructions and scoring criteria were provided to the three experts? Did they separately assess unsupported risk allegations, missed management concerns, and inappropriate recommendations, or primarily evaluate overall caption quality?
-
Does GovLA-10K contain compliant scenes involving the same object categories, and how are visually uncertain cases annotated? Please explain how the annotation process avoids equating category presence with a confirmed violation.
-
Do the Table 2 baselines receive the same three feature streams as SGA? Please clarify how input information, output token counts, and training settings are controlled when attributing the gains to the adapter architecture.
-
Is any reported baseline the explicit detector–VLM pipeline illustrated in Figure 4, using the same detector predictions? If so, please identify its results and explain what existing evidence supports reduced error propagation.
2 comments
Thank you very much for the author's response. However, based on the author's current reply, I still find it difficult to determine whether the model truly adjusts its risk assessment and disposal recommendations based on specific visual evidence. Therefore, I will maintain my original rating.
Response to Reviewer fWAk
Appreciation
We sincerely thank Reviewer fWAk for the constructive comments on evaluation reliability, adapter comparison fairness, and coordination mechanisms, as well as the valuable suggestions for improving the rigor of our experimental validation. Our point-by-point responses are provided below.
R1: Clarification on Shared Reviewer Concerns
Please refer to our common response titled "Clarifications on Common Concerns Raised by All Three Reviewers" at the top of this page, where we provide detailed clarifications on VLM comparisons and coordination mechanisms, adapter comparison fairness, expert evaluation reliability, and annotation quality and data independence.
R2: Clarification on Output Token Consistency
We further clarify that the output token counts of all adapters are strictly controlled to ensure a fair architectural comparison. Specifically, all adapters receive the same three feature streams and produce an identical number of visual tokens, corresponding to the spatial resolution of the original 512 × 512 image downsampled by a factor of 64, i.e., (512/64) × (512/64) = 64 tokens. This standardized output configuration eliminates token-count differences as a confounding factor and allows the comparison to focus on each adapter's ability to integrate heterogeneous grounding features. Moreover, since the explicit detector–VLM pipeline directly uses the original image as visual input, this design maximizes the consistency of the visual representation budget between explicit and implicit coordination frameworks, facilitating a fair comparison of their effectiveness.
R3: Clarification on Visual Evidence and Error Propagation
Furthermore, the qualitative comparison in Appendix E provides visual evidence of the limitations of explicit coordination. Specifically, although the explicit detector–VLM pipeline accurately identifies and specifies the spatial locations of regions of interest, the VLM still introduces descriptions and considerations of moving vehicles that are not directly relevant to the primary governance concern in the illustrated scene. This suggests that explicitly providing grounding information does not necessarily guarantee that the subsequent language generation remains focused on the intended regions, potentially introducing irrelevant information during cross-stage coordination. In contrast, our implicit feature integration enables more focused interpretation of governance-relevant visual evidence, as illustrated by the corresponding results. These observations qualitatively support our motivation to mitigate information distortion and error propagation through implicit coordination.
R4: Clarification on Violation-Oriented Data Selection
We emphasize that GovLA-10K specifically targets scenes containing identifiable governance violations, rather than arbitrary images containing governance-related objects. During the first annotation stage, we explicitly screen the collected images and retain only those exhibiting visually verifiable violations. Images containing merely relevant objects without sufficient evidence of violations, as well as ambiguous cases, are excluded. Therefore, the presence of an object category is never treated as sufficient evidence of a violation. This selection process ensures that the benchmark focuses on identifiable violation scenarios, supporting the evaluation of scene descriptions and contextually appropriate management recommendations. Accordingly, GovLA-10K primarily addresses violation-oriented interpretation and recommendation generation rather than binary compliance classification.
Expectation
We will incorporate all the above clarifications and implementation details into the revised manuscript to improve the clarity and completeness of our work. We sincerely hope that our responses have adequately addressed your concerns, and we would greatly appreciate it if you would consider raising your evaluation score accordingly. Thank you again for your valuable feedback and consideration.