- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
PHANERO is a test time correction method for VLM object localization / referring object detection, especially for partly occluded target objects. PHANERO fits a transform on the frozen LLM decoder's final hidden state from occluded objects to clean ones, using synthetic occlusion in COCO. At inference, the transform corrects the hidden state, and the VLM outputs bounding box as text to recover the localization. PHANERO is evaluated with 3 different VLMs, on COCO as well as KITTI and HOOT, demonstrating improved localization recall.
Critical strengths
S1. The method itself is well motivated and easy to understand. The motivation is to recover the "clean" representation for the occluded objects in the VLM feature space, which is an interesting and under-explored topic.
S2. The method is cheap and flexible as a training-free plugin, which is supported by the experimental results generalizing to different backbones and unseen datasets.
Critical weaknesses
W1. Potentially false or overstated claims, given the existing experiments:
- W1.1 A central claim is that PHANERO recovers the clean final state. This is neither well-defined nor explicitly measured.
- W1.2 Related to W1.1, despite the central claim being to recover the occluded objects, the corrected objects as shown in Figs 3-5 do not appear to be heavily occluded.
- W1.3 The authors claim that the gain does not come from "just add boxes". However the FP-AP results suggest that under a precision aware metric, PHANERO underperforms the baseline, which contradicts this claim.
W2. Flaws in experimental design:
- W2.1 Baseline comparison is not sufficient. The two null baselines are not very informative and in my opinion should go to the appendix, while more reviewed methods in appendix Table 8 should be reproduced and added to the main tables.
- W2.2 Possibly weakened main competitor: Localization Heads shows almost no effect, which is clearly different from what their original paper reports, what's the reason for this?
- W2.3 Artificial occlusion is used to estimate the transform, for which more details and analysis should be provided.
W3. Presentation is poor, the writing style is neither professional nor scientific, making it extremely difficult to follow.
Questions for authors
Please address the critical weaknesses.