- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Value-Order Decomposition (VOD) for generalist anomaly detection, splitting residual features into a gap-invariant value component and a gap-specific order component. Using only the value component, VODA combines few-shot normal references with synthetic anomalies for image- and pixel-level detection.
Critical strengths
- The problem formulation is clear and easy to follow.
- The proposed method is simple-yet-effective and large-scale experiments were conducted to verify its effectiveness.
- The proposed method does not rely on real anomalies, which are hard to collect in real world.
Critical weaknesses
Novelty. Despite the effectiveness of the proposed method VODA, the novelty is relatively limited, and I am afraid that it fails to provide a new insight for GAS. The core technique in VODA is VALUE-ORDER DECOMPOSITION. Particularly, it sorts the residual features in a descending order, and then select the largest value for anomalous score. This is similar to TopK operation. Is it possible to directly use TopK? Besides, after value-order decomposition, the order information is not used but is discarded in VODA. Why? More related works on value-order decomposition can be introduced.
Limited theoretical contributions. Proposition 2 and 3 essentially state "strict monotonic transformation preserves sorting" and "sorting remains invariant to permutation", which are mathematically correct but relatively obvious. They illustrate the properties of value and order, but cannot directly prove the core assumption that "abnormal information is mainly encoded by residual magnitude and gap information is mainly encoded by order". This hypothesis is more supported by experiments, and the theoretical evidence is still weak.
Concerns about Fig. 3c. In Fig. 3(c), the value for 1D and 2D examples are converse. Is that reasonable? Could you explain this?
Questions for authors
See weakness.
5 comments
R3W2
We thank the reviewer for this insightful comment. Specifically, we clarify the core hypothesis underlying VOD and explain how the mathematical properties established in Propositions 2 and 3 provide a theoretical basis for interpreting the value and order components in terms of gap-invariant and gap-specific abnormality-related information, respectively.
First, we would like to clarify the semantic correspondence between the two components and the information they capture. Our hypothesis is not simply that abnormal information is encoded in value while gap information is encoded in order. Rather, we associate value with gap-invariant abnormality-related information and order with gap-specific abnormality-related information. Both components may contain cues for distinguishing normal and abnormal patterns; the distinction lies in whether the captured abnormality-related information remains stable across different gaps.
The mathematical properties established in Propositions 2 and 3 provide a theoretical basis for understanding the respective roles of the Value and Order components in capturing gap-invariant and gap-specific abnormality-related information, as follows:
(1) Order is associated with gap-specific abnormality-related information because it captures structural characteristics that vary across different gaps. Specifically, different object categories exhibit different shapes and textures, different defect types exhibit different geometric patterns, and different domains (e.g., industrial and medical domains) exhibit distinct structural and semantic characteristics. Such variations can affect the relative responses of feature channels and thus their rankings. This interpretation is supported by previous studies on ordinal representations and feature distribution matching, particularly EFDM, which suggest that feature ordering can preserve structural and content information. This observation is also illustrated in Fig. 3(c), motivating us to associate order with gap-specific structural and abnormality-related information.
(2) The theoretical properties, together with the above interpretation of order, provide a basis for associating value with gap-invariant abnormality-related information. Specifically, Property 1 establishes that value preserves the empirical distribution of residual magnitudes, which retains magnitude-based information relevant to anomaly identification, since abnormal patches tend to exhibit larger residual responses. Moreover, the subsequent propositions characterize the complementary behaviors of value and order: Value is invariant to permutations of the original channel ordering, whereas order preserves the corresponding relative channel rankings. More intuitively, when structural variations across different gaps induce different permutations of the same residual-value multiset, value remains unchanged, whereas order captures the corresponding structural differences. Thus, value retains magnitude-based abnormality cues that are invariant to such structural variations, while excluding the gap-specific information reflected in channel ordering.
Thus, the mathematical properties provide a theoretical basis for interpreting the invariance characteristics of the two components in terms of gap-invariant and gap-specific information. This interpretation is further supported by the t-SNE visualizations in Figs. 3(a) and 6, as well as the probing experiments in Table 5. We will revise the theoretical discussion to make the connection between these mathematical properties and their implications for gap-invariant and gap-specific representations more explicit.
R3W3
We thank the reviewer for pointing this out. The inconsistency in Fig. 3(c) was caused by a coding error in generating the figure. We have corrected the error and updated the figure to ensure that, for both the 1D and 2D examples, the value-based and order-based representations are correctly obtained through VOD with descending sorting. We apologize for this oversight.
Thank you for your response and the additional experiments. The response has addressed some of my concerns about Fig. 3(c) and the theoretical assumption.
However, I still have some questions. 1) As I mentioned before, the VOD method is similar to top-K operation. While the authors have provided explanations of the differences between the two and provided related experiments to support the effectiveness of the proposed method, I do not think that comparative experiments is convincing. In the proposed method, the authors use top 1% highest values, which generates over 2000 values from S (448 $\times $ 448). However, the authors only adopt top-5 and top-10 to compare with VOD. 2) Although the theoretical assumption is relatively convincing, the Proposition is still simple and obvious, which weakens the theoretical contribution.
R3W1
We thank the reviewer for this insightful comment. We emphasize that our contribution does not lie in introducing a new sorting operation. Rather, the novelty of VOD lies in explicitly decomposing residual features into value and order components and investigating their distinct roles in generalist anomaly detection. Our key insight is that these two components exhibit different behaviors under cross-gap variations: the complete value distribution provides a more stable representation, whereas the original channel ordering can capture gap-specific structural patterns that may hinder generalization. To substantiate this contribution, we further clarify the distinction between VOD and Top-k selection, explain why order is excluded from the final anomaly scoring, and discuss conceptually related rank- and ordinal-based representations.
(1) Difference between VOD and Top-k selection. VOD does not simply select the largest residual value after sorting. Specifically, we sort to the entire residual feature vector in descending order, retaining all residual magnitudes while removing their original channel ordering. The resulting full-dimensional value representations of query patches and synthetic abnormal references are then used for similarity-based abnormal reference matching. To further investigate the difference, we compare VOD with Top-k variants (k=5,10), as reported in Table F. Top-k can be regarded as a truncated version of the value component, retaining only the largest residual responses while discarding the remaining values. Consequently, Top-k loses the relative magnitude relationships between the retained and discarded values within each patch, potentially overlooking informative distributional patterns. In contrast, VOD preserves the complete sorted residual value distribution. Moreover, Top-k is sensitive to the choice of k. As shown in Table F, the Top-k variants consistently underperform VOD. These results demonstrate the importance of preserving the complete residual value distribution rather than relying only on a subset of high-magnitude responses.
Table F. Image-level/pixel-level AUROC under the 4-shot setting.
(2) Why discard order information. Our motivation for retaining value while discarding the original channel ordering is to obtain a more generalizable representation for cross-gap AD. As analyzed in Section 3.1, value preserves the complete distribution of residual magnitudes and is invariant to channel permutations (gap-invariant). In contrast, order captures the relative rankings of feature channels, which reflects gap-specific structure patterns. Although such information can be useful for distinguishing anomaly-types, it may also introduce sensitivity to structural variations across different gaps. Therefore, excluding order reduces the dependence on potentially gap-specific channel-ranking patterns, allowing the model to focus on the more stable residual magnitude distribution. Please refer to R3W2 for further discussion of the semantic correspondence between value/order and gap-invariant /gap-specific abnormal information.
(3) Related work. To the best of our knowledge, explicit value-order decomposition of feature representations has received little attention in computer vision. We therefore discuss several conceptually related studies on rank- and ordinal-based representations. For example, SIFT-Rank [1] represents local descriptors using the relative ranks of feature values, while Yagnik et al. [2] construct ordinal embeddings based on partial-order statistics. Although these methods exploit relative ordering information, they do not explicitly disentangle feature magnitudes from their original ordering. In contrast, VOD explicitly decomposes residual features into the sorted magnitude distribution (value) and the corresponding channel ordering (order), allowing us to investigate their distinct roles in generalist anomaly detection.
[1] Toews M, Wells W. Sift-rank: Ordinal description for invariant feature correspondence. CVPR 2009.
[2] Yagnik J, Strelow D, Ross D A, et al. The power of comparative reasoning. ICCV 2011.