- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the false-negative trap in source-free instance adaptation, where omitted objects in pseudo-labels may be incorrectly supervised as background. To address this issue, the authors propose Recall-Prior Masking (RPM), which combines RPN-guided Informed Cutout with Gradient Masking to suppress potentially harmful supervision. Experiments on three domain adaptation benchmarks demonstrate improved terminal detection and instance segmentation performance, along with reduced late-training degradation.
Critical strengths
-
The manuscript is clearly written, with a well-motivated problem formulation and a logical presentation of the proposed method. The distinction between false-positive and false-negative pseudo-label errors is particularly easy to follow.
-
Clear illustrations and straightforward methodology.
-
Reasonable design of Gradient Masking.
Critical weaknesses
My primary concern lies in the first component, Informed Cutout, whose design appears highly counterintuitive. According to Section 3.2.1, the method masks all selected high-objectness RPN proposals, including regions corresponding to existing positive pseudo-labels, while retaining the original pseudo-label supervision. Consequently, the student may receive images in which a substantial portion of the foreground evidence has been removed, yet it is still expected to accurately classify and localize the corresponding objects. The current explanation does not convincingly justify why this potentially inconsistent supervision should improve detection.
More importantly, Table 4 indicates that Informed Cutout contributes substantially more to the performance improvement than Gradient Masking. However, the authors provide limited analysis of why such aggressive foreground masking is beneficial. I strongly encourage the authors to extend Table 4 by introducing controlled comparisons with standard Random Cutout and the Stochastic Complementary Masking strategy in SOCCER (Stochastic Context Consistency Reasoning for Domain Adaptive Object Detection, ACM MM 2024). Similar to SOCCER, the masking ratio should be explicitly controlled and analyzed to determine whether the improvements primarily depend on masking locations, masking proportions, or the proposed RPN-guided strategy.
Another important concern is the potential shortcut introduced by proposal-guided masking. Since the masked regions directly correspond to RPN proposals, the student may learn to exploit the locations and shapes of the gray-filled regions as artificial localization cues rather than learning meaningful object representations. Furthermore, when discriminative foreground evidence is largely removed, it becomes unclear how the student can reliably distinguish visually similar categories, such as cars, trucks, and buses, based mainly on the remaining background context.
Questions for authors
-
How do the authors justify the effectiveness of Informed Cutout when positive objects are heavily masked but their pseudo-labels remain unchanged? Please consider extending Table 4 with Random Cutout and SOCCER-style stochastic complementary masking under matched masking ratios. How sensitive is performance to masking location and proportion? Additionally, how can the authors rule out shortcut learning from gray-filled proposal regions and explain reliable classification of visually similar categories when foreground evidence is largely removed?
-
Why is the Cutout filling value fixed at 127? Is there any specific motivation for this choice? Have the authors evaluated other filling values, and how sensitive is the final performance to this parameter?