- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
- A large-scale dataset is proposed for object-goal UAV search.
- Several LLMs are evaluated on the proposed dataset.
Critical strengths
- The scale of the dataset is much more bigger compared with existin datasets.
- More scenarios are used when consturcting such a datast.
Critical weaknesses
-
The paper proposes a large-scale benchmark for object-goal search, but the value of its scale is not fully demonstrated. Compared with the existing benchmarks listed in Table 1, what specific benefits does the increased scale bring? The authors should provide further analysis to justify the necessity and significance of such a large-scale dataset.
-
The quality of Figure 2 needs to be improved. If AI-generated content was used, the authors should carefully verify its accuracy and consistency, as AI-generated images may contain unrealistic or unreasonable elements.
-
The evaluation metrics, including SR, OSR, DTS, SPL, and CR, are relatively standard and do not sufficiently reflect the unique characteristics of the proposed benchmark or its task design. Beyond the increase in dataset scale, what distinguishes this benchmark from existing ones, and how can its added value be quantitatively evaluated? The authors should consider introducing more task-specific metrics or analyses to better demonstrate its contributions.
Questions for authors
- What specific benefits does the increased scale bring?
- What distinguishes this benchmark from existing ones, and how can its added value be quantitatively evaluated?