- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents TRRC-HETMM, an extension of HETMM for industrial inspection settings in which normal texture on a carrier strip causes false alarms but cannot be removed from the inspection region. The method has three parts. It first estimates a position-conditioned subspace of normal feature variation and reweights query-template residuals inside and outside that subspace. It then calibrates fast and full decision thresholds under separate miss-risk budgets. Finally, a dynamic policy makes fast decisions for apparently unambiguous samples and sends gray-zone or guard-triggered samples to full PTS-60 matching.
The main evaluation uses an entity-disjoint private chip dataset with 1,000 defective and 19,000 normal test images. The final system reports four missed defects and 2,765 false positives, compared with 48 misses and 3,895 false positives for HETMM at its frozen operating point. The paper also reports public-benchmark results on MVTec AD, VisA, and Real-IAD, a targeted texture-suppression intervention with an equal-energy control, module ablations, and end-to-end timing.
Critical strengths
-
The paper takes the deployment setting seriously. Templates, validation, calibration, and test data are separated by physical chip identity, and the authors distinguish continuous-score ranking from errors at a frozen operating point. The paper is also careful about the scope of its statistical claim: the conformal result assumes exchangeability and does not guarantee safety under process drift.
-
The mechanism study is stronger than a routine ablation. The authors combine residual-direction statistics with a targeted strip-frequency intervention, an RMS-matched shuffled control, and region-specific detection counts. This provides concrete evidence that normal strip texture contributes to false positives and that the improvement is not explained by indiscriminate response suppression alone.
Critical weaknesses
-
The supplementary artifact does not adequately support the central numerical results and raises concerns about the paper's reproducibility claims. The paper states that the archive provides the implementation used on the experimental server. However, the archive reportedly states that it is not a verified export of that environment, that the original server artifacts and end-to-end numerical regression are unavailable, and that the exact fast-template order and score scaling have not been regression-tested. Calibrated thresholds must also be copied manually into the inference configuration. Although the 20 unit tests pass, they verify only core operations rather than the reported industrial counts, AUROC, or timing. Since the private data and several intervention settings are also unavailable, the main experimental results cannot currently be independently verified.
-
The methodological novelty is limited, and the advantage of the proposed texture-disentangled metric over simpler alternatives is not sufficiently established. The framework combines a position-conditioned low-rank residual metric, standard conformal risk calibration, and heuristic dynamic routing on top of HETMM. While this integration addresses a practical industrial problem, the individual components are closely related to existing techniques. In particular, the texture-disentangled distance is essentially a position-conditioned quadratic metric based on covariance eigendecomposition and residual reweighting. Its relationship to established approaches such as Mahalanobis distance, PCA residual distance, and feature whitening is not sufficiently investigated. Without comparisons against these simpler statistical alternatives under the same HETMM framework, it remains unclear whether the proposed metric provides a distinct methodological contribution or whether similar improvements could be obtained through standard covariance-aware reweighting.
-
The public evidence is not strong enough to establish broad generality. Table 2 reports AUROC pooled over all test samples, without per-category results, standard category-macro averages, confidence intervals, or analysis of variability across different data splits. Pooled AUROC can be affected by differences in anomaly-score scales across categories and may not adequately reflect performance within individual object categories. Although the private industrial results are impressive, the public experiments do not yet provide a sufficiently comprehensive and independently auditable substitute, particularly given the reproducibility limitations of the private dataset.
Questions for authors
-
The paper states that the supplementary archive contains the implementation used on the experimental server, whereas the archive reportedly indicates that it is not a verified server export and that the original artifacts and numerical regression are unavailable. Which statement is accurate? Can Tables 1–5 still be regenerated from a preserved internal environment, and can the authors provide hashes or derived per-sample scores linking that environment to the reported results?
-
How were the first 30 fast-route templates selected and ordered in the actual experiments, and what exact score scaling produced the thresholds 0.58, 0.68, and 0.72? The archive reportedly states that these details have not been regression-tested. Would changing the template order affect the routing counts or miss rate?
-
How does the proposed texture-disentangled distance compare with simpler position-wise covariance-aware metrics, such as Mahalanobis distance, PCA residual distance, or feature whitening, under the same HETMM framework? Such comparisons would help establish whether the proposed formulation offers a distinct methodological advantage beyond standard statistical reweighting.
-
Please report category-wise image and pixel AUROC, standard category-macro averages, and uncertainty estimates for MVTec AD, VisA, and Real-IAD. Why is pooled AUROC used as the main public metric when anomaly-score scales can differ across categories?
-
With 600 defective calibration samples, the minimum corrected risk is , so the two branch budgets are feasible only with zero calibration misses. How stable are the selected thresholds and test miss rate across repeated entity-disjoint calibration splits?
Response to Reviewer ghBX
Thank you for the detailed questions. We clarify the implementation, metric comparison and calibration below.
Implementation and verification We have prepared an updated implementation with explicit scoring conventions and calibration artifacts linked to the source, weights, templates and scoring policy. Inference loads calibrated thresholds automatically. Verification includes implementation tests, GPU/real-image checks and numerical tests for the added comparison, documented by fixed configurations, reference selections, per-image scores and hashes. Exact regeneration of Tables 1-5 and verification of their original configuration remain incomplete.
Fast templates and score conventions The prepared implementation uses L3 prototype indices 0-29 from the PTS-60 bank, records their source indices, and applies a sigmoid to the raw fast score. PTS planes need not correspond to whole reference photographs.
Changing which prototypes enter the first 30 can affect scores and routing. Permuting an unchanged selected set preserves the mathematical min/max reductions. Subset sensitivity has not been measured. The values 0.58 and 0.68 denote fast-normal and full-normal release; 0.72 is the validation-fixed fast-defect cutoff. Release thresholds require calibration for each frozen scoring policy.
We completed a comparison on all 15 MVTec AD categories and 1,725 official test images. Methods share normalized features, normal-training covariance estimates, 16 fixed normal references per category, an ALL bank, matching neighborhoods and aggregation. Input and pixel evaluation are 256x256. TD retains the industrial weights 0.25/1.0 without test-result retuning. This is a common-bank metric control, distinct from the industrial 640/PTS-60 protocol and an official HETMM reproduction.
PCA residual performs best in this setting, so a general advantage for the fixed TD metric is not established. TD's parallel coefficient is 0.25/max(lambda,1e-6), allowing greater weight on low-variance directions. Its intended distinction is position-conditioned directional costs within mutual matching, coupled to calibrated release. We agree that the constituent PCA and risk-calibration tools are established techniques.
Category-wise image/pixel AUROC (%) under the control above: