- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces the IRSTD‑Agent agent framework, which formulates infrared small‑target detection as a dynamic visual‑search task. It designs five visual tools including PROPOSAL, ZOOM, DETECT, DROP and REFINE to accomplish candidate generation, adaptive zoom‑in, target localization, disturbance elimination and target‑boundary refinement. It also proposes Zoom‑guided Interaction Learning, which constructs positive and negative interaction trajectories based on ground‑truth annotations to supervise large‑language models in learning tool invocation and parameter selection. Extensive experiments are conducted on the WideIRSTD‑Full and IRSTD‑1k datasets, which effectively improve the localization accuracy of multimodal large‑language models for infrared small‑target detection. Nevertheless, sequential tool invocations bring additional inference overhead, and detecting extremely tiny targets with ambiguous features still poses challenges.
Critical strengths
1.It innovates in task paradigm by transforming infrared small‑target detection into agent‑driven dynamic visual search. It locally zooms in to search for targets directly on original‑resolution images without image compression. 2.It proposes a set of dedicated visual tools with well‑defined complementary responsibilities. Reasonable division‑of‑labor among these tools yields noticeable performance gains when combined. 3.It presents Zoom‑guided Interaction Learning (ZIL) to optimize the agent’s tool‑calling strategy, adopting the trick of joint positive‑and‑negative trajectory supervision.
Critical weaknesses
1.Serial tool reasoning incurs heavy computational overhead. Experiments require multiple rounds of MLLM inference, resulting in high latency. 2.It heavily relies on high‑quality manual annotations for constructing interaction trajectories. Zoom‑guided Interaction Learning requires manually building complete positive and negative interaction trajectories from ground‑truth annotations for SFT fine‑tuning. Valid training trajectories cannot be produced without high‑quality dataset annotations; poor‑quality annotations will directly corrupt the learning of tool‑calling policy and lead to severe performance degradation. 3.The PROPOSAL candidate‑generation tool has inherent flaws. Generating candidates via spatial filtering and FFT‑based frequency‑domain saliency, this hand‑crafted feature is prone to being triggered by heavy clutter and high‑light noise points, producing numerous false candidates. This increases subsequent ZOOM iterations and further raises inference overhead. Moreover, the real target will be missed entirely if it is not selected as a candidate by PROPOSAL.
Questions for authors
This paper compares extensively against general‑purpose multimodal large‑language models and generic active visual‑search baselines, yet it lacks comparisons against domain‑specialized infrared small‑target detection algorithms with comparable‑scale backbones. Does the proposed method outperform these dedicated approaches across all metrics?
The author have well responsed to all my concers. My concerns have been addressed