- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes OpenMorphoQuery (OMQ), which detects and segments industrial defects unseen during training using a few region-annotated visual exemples. It extends DINOv with three modules that reduce feature entanglement, refine defect prototypes, and initialize queries using target-image features. Across 4 datasets with 147 seen and 52 unseen categories, OMQ achieves box and mask AP scores of 28.5 and 21.5, outperforming DINOv by 6.5 and 5.3%p, respectively. Ablation studies and response alignment analyses further support its effectiveness.
Critical strengths
- The paper addresses a practically relevant problem through an intuitive interface. The reported performance supports the effectiveness of its approach to addressing feature entanglement in existing methods.
- The method delivers substantial improvements over its base model, DINOv, in both box and mask AP. Performance improves as the proposed modules are added cumulatively.
- In the prompt-scaling experiments, the method consistently outperforms the baseline across 1~5-shot settings. OMQ also achieves better results in the response alignment analysis.
- The method extends DINOv with a small parameter overhead of approximately 200k additional module parameters.
Critical weaknesses
- Evidence for the central mechanism is indirect. Table 5 quantitatively demonstrates better alignment between model responses and actual defect regions. However, the analysis does not sufficiently distinguish whether these improvements arise from mitigating the claimed morphology reference-frame mismatch or from more general benefits of feature aggregation, normalization, or improved query initialization.
- Although the main hyperparameter values are disclosed in Table A2, their selection rationale and the sensitivity of performance to these settings are insufficiently analyzed. In particular, it is difficult to assess the effects of the NMDE dictionary size and temperature, the PCPE weights, and the PTQI weight settings.
- Validation of the robustness and scope of the improvements is limited. The paper does not report variability across training seeds or resampled support sets, making it difficult to determine whether the observed gains persist under these changes. Moreover, on GC10-DET, box and mask AP are 7.5 and 4.3 %p lower than those of DINOv, respectively. Further analysis is needed to explain this degradation and clarify the method's limitations.
- Comparative analysis of training and inference efficiency is insufficient. Computational efficiency is an important consideration when deploying the method in industrial inspection settings. The paper does not compare training time, inference latency, or memory usage against DINOv under matched conditions, making it difficult to assess the trade-off between the performance gains and the computational cost of the additional modules.
Questions for authors
Clarifying the following points would help assess the methodological contributions and interpret the experimental results.
- Mechanism validation: Could you provide controlled experiments to establish whether the gains arise specifically from reducing morphology reference-frame mismatch in exemplar features, beyond the benefits of general feature processing or improved query initialization?
- Robustness and failure conditions: Do the improvements persist across multiple training seeds and resampled support sets? What accounts for the lower performance relative to DINOv on GC10-DET?
- Hyperparameters: What validation procedure was used to select each module's hyperparameters? Could you report how performance varies with the main hyperparameter settings?
- Computational efficiency: How much do training time, inference latency, and memory usage increase relative to DINOv under identical hardware and input conditions? These measurements would help assess the performance gains relative to the additional computational cost.