- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Test-Time Prototype Adaptation (TPA), a gradient-free online adaptation mechanism for few-shot industrial anomaly detection and segmentation. Unlike existing methods that either keep normal references fixed (suffering from batch-to-batch domain shifts) or update them based on global feature proximity (risking widespread prototype contamination), TPA indexes prototypes strictly by dense spatial location. Using a frozen vision transformer (DINOv3), TPA employs Dual Anomaly Scoring (DS) to gate incoming patches, Adaptive Prototype Update (AP) to apply counter-weighted running-mean updates to admitted patches at their specific locations, and Dynamic Attention Weighting (DAW) to reweight the anomaly map based on historical consistency. Evaluated on three IAD benchmarks and one IFSS benchmark, TPA demonstrates significant improvements (e.g., +5.6 image-AUROC over static references) with negligible computational overhead (+0.09 ms per image, +11 GFLOPs).
Critical strengths
- Computational Efficiency and Practicality: The gradient-free nature of TPA makes it remarkably efficient. The addition of just 0.09 ms and 11 GFLOPs per image over a frozen baseline makes this approach highly viable for high-throughput, edge-deployed industrial inspection pipelines.
- Elegant Handling of Contamination via Spatial Indexing: By indexing prototypes by location and using a local counter, the method ensures that any false admissions (contamination) remain localized and undiluted, rather than polluting a global class prototype. This elegantly exploits the fixed-viewpoint prior inherent to most industrial inspection setups.
Critical weaknesses
- Vulnerability to Spatial Misalignment: As explicitly acknowledged in the supplementary material (S3.3), the method fundamentally relies on strict spatial alignment (fixed-viewpoint acquisition). Under moderate object pose, scale, or viewpoint shifts, the dense spatial correspondence breaks, rendering the local prototype tokens and the spatial-context score (Es) invalid.
- Inability to Perform Infinite-Horizon Tracking: The Adaptive Prototype Update (AP) relies on a strict counter-weighted mean (). As grows, the effective learning rate approaches zero, meaning the estimator converges and stops adapting to long-term drift. While this protects against early contamination, it limits the method's claim as a continuous test-time adaptation framework for long-running deployment streams.
Questions for authors
- Regarding spatial alignment: While Table 8 ablates the spatial term, how significantly does the entire TPA pipeline degrade if applied to a dataset with inherent geometric variations (e.g., slight rotational or translational jitter of the target object)?
- Regarding the counter-weighted mean: You noted the trade-off between early stability and long-horizon tracking. Have you experimented with a hybrid decay scheme (e.g., switching to a small, fixed Exponential Moving Average once the counter reaches a certain threshold) to allow continuous infinite-horizon adaptation without risking early collapse?
I thank the authors for a thorough, candid rebuttal. The B=1 predict-then-update control (−0.2/−0.4), the matched component ladder (R4), and the nested-support drift interaction are the right experiments, and I credit the disclosure of adverse results (Noise −0.2, EMA above TPA, contract-A below QGNet). However, although revision is permitted, the manuscript's structure and presentation remain inadequate, and the authors have not submitted a revised version addressing the review comments. The stated changes exist only in the rebuttal, not in the paper. I therefore maintain my original score.