- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces SCOPE, a framework for tabular anomaly detection that uses a frozen tabular foundation model without any parameter updates or anomaly-specific pretraining. Instead of using conditional feature prediction directly as an anomaly score, SCOPE treats predictive discrepancies as positive evidence: it bootstraps candidate anomalies via conditional feature prediction residuals and predictive-quantile spacing, then constructs an in-context discriminative regression task.
Critical strengths
- SCOPE keeps the tabular foundation model frozen throughout. This makes the method adaptable to new datasets without gradient-based optimization.
Critical weaknesses
- SCOPE uses unlabeled target covariates to construct positive evidence. While outer cross-fitting exists, the method assumes access to the full target pool before scoring, which is hard to hold in practice.
- The main experiments use TabICL as the frozen backbone. Backbone comparison is limited to ADBench and shows TabPFN-2.5 performs lower, while EXAONE-Tabular is numerically higher but not significantly different. It remains unclear how sensitive SCOPE is to the choice of foundation models.
- The cross-fitted refinement and evidence resampling procedures are heuristic. There is no formal analysis of why the self-constructed positive evidence can improve the performance.
- The writing logic needs to be improved. Many parts require multiple readings to fully understand the meaning.
Questions for authors
- How does SCOPE perform with different frozen tabular foundation models?
- Can you provide any theoretical analysis of the cross-fitted refinement or evidence resampling?
- Are there datasets or anomaly types where SCOPE performs poorly relative to baselines?
3 comments
Thanks for your rebuttal. However, I believe the original issue still persist.
For Weaknesses 1, I still do not know how can you ensure an unlabeled target-distribution pool exists in practice.
For Weaknesses 2, the issue about "improvements may derive fundamentally from the foundation model rather than SCOPE" is not resolved. The new table only shows the performance of SCOPE depends on the frozen model.
For Weaknesses 3, a rigorous proof is difficult, but the current explanation is still not convincing.
Overall, I tend to keep my rating.
Thank you for your follow-up. We understand your remaining concerns and appreciate the opportunity to clarify our scope and contributions.
1. Target-pool assumption. We agree that access to an unlabeled target-distribution pool is an explicit requirement and is not guaranteed in every deployment setting. SCOPE is intended for pool-based anomaly detection, where unlabeled observations are available to construct reusable scoring contexts. We have clarified this limitation rather than claiming general inductive applicability.
2. Contribution beyond the backbone. We agree that cross-backbone comparisons alone do not isolate SCOPE's contribution. Under the same frozen TabICL backbone, converting predictive evidence into discriminative supervision improves AUROC from 77.02 to 84.56, with refinement further improving it to 85.08. Additionally, SCOPE outperforms a PU-style baseline using the same backbone and unlabeled pool across all three benchmarks (+2.39, +3.71, and +2.09 AUROC). These results support the effectiveness of our evidence-construction and in-context supervision strategy, rather than attributing the gains solely to the pretrained backbone.
3. Methodological justification. Our approach is motivated by discriminative novelty detection, where differences between normal and contaminated unlabeled distributions can provide anomaly evidence. Cross-fitting prevents a query from directly contributing to its own scoring context, while refinement uses discriminative ICL to update the initial evidence. We acknowledge that neither mechanism guarantees accurate pseudo-positive selection or improved detection performance, and therefore present the supporting experiments as empirical evidence rather than theoretical guarantees.
We respect your assessment and appreciate your feedback, which has helped us clarify the assumptions, methodological contributions, and limitations of SCOPE.
We thank the reviewer for the constructive feedback. We conducted additional analyses to clarify SCOPE's applicability, methodological rationale, and empirical robustness.
1. Target-Pool Assumption
SCOPE requires an unlabeled target-distribution pool, but does not require future queries to be available during evidence construction. Outer cross-fitting separates evidence construction from query scoring, allowing constructed contexts to be reused for subsequent observations.
We additionally analyzed fold-wise performance across all three benchmarks:
Average ranks (lower is better). SCOPE results are derived from existing fold-wise cross-fitted predictions, whereas baselines use released full-test evaluations. This is not an independent inductive benchmark.
These results illustrate the separation between evidence construction and scoring while retaining favorable average ranks. We have clarified the unlabeled-pool assumption and its limitations.
2. Generalization Across Frozen Backbones
SCOPE achieves the following performance on ADBench with three frozen TFMs under the corrected group-aware protocol:
These results demonstrate that SCOPE's discriminative evidence construction is applicable across multiple frozen TFMs, rather than depending on TabICL alone. Backbone choice affects performance, and this analysis is limited to ADBench.
3. Theoretical Motivation and Mechanism
SCOPE is motivated by discriminative semi-supervised novelty detection (Blanchard et al., 2010), which connects discrimination between normal and contaminated unlabeled distributions to anomaly detection.
SCOPE differs by constructing pseudo-positive evidence through conditional feature prediction, refining it via cross-fitted discriminative ICL, and using the refined evidence for final in-context supervision without parameter updates.
Cross-fitting limits direct self-reinforcement, while evidence resampling aggregates predictions across multiple candidate contexts. These provide methodological motivation rather than a formal guarantee for SCOPE's data-dependent evidence selection.
Empirically, converting bootstrap evidence into discriminative supervision improves AUROC from 77.02 to 84.56, with refinement further increasing it to 85.08. Refinement also increases top-q precision from 50.2% to 66.0%. Removing both evidence-guided selection and graded target encoding reduces AUROC/AUPRC from 85.08/66.84 to 81.33/60.85.
Together, these results support the importance of constructing, refining, and exploiting informative positive evidence.
4. Performance Conditions and Failure Cases
SCOPE maintains leading aggregate performance across ADBench, OddBench, and OvRBench, although its effectiveness depends on informative positive evidence.
Performance is less competitive below 1% anomaly prevalence, where pseudo-positive evidence is more likely to contain normal observations, and with very small mining pools. Certain datasets, such as musk, also favor simpler detectors.
In an oracle diagnostic on 145 low-prevalence entries, removing true anomalies from positive contexts reduces AUROC from 0.771 to 0.757 and AUPRC from 0.133 to 0.058.
These results highlight the importance of informative evidence and characterize conditions under which SCOPE is less effective. The oracle intervention is diagnostic, not part of unsupervised inference.
5. Presentation and Clarity
We have revised the methodology to distinguish (i) bootstrap evidence construction, (ii) cross-fitted discriminative refinement, and (iii) final evidence-guided scoring. We also aligned Algorithm 1 with the implementation, clarifying that binary targets are used during refinement and graded targets only during final scoring.
We appreciate the reviewer's feedback, which helped us better articulate SCOPE's methodological contribution and empirical scope.