- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TabMATE, which treats heterogeneous unsupervised anomaly detectors as "agents" and learns a weight for each detector from a few confirmed anomalies via exponentiated gradient (EG). The final score is a weighted average of the detectors' rank-normalized scores.
Critical strengths
- The analysis of label-free coordination is convincing: consensus-based rules track agreement among detectors rather than their quality, and thus suppress useful minority specialists.
- The complementary strengths of detectors across anomaly types are clearly shown.
Critical weaknesses
- The paper ignores that each unsupervised detector works well only when the data matches its assumption, so the problem is essentially few-label model selection. This explains why (1) weights are per dataset, contradicting the per-sample motivation, and (2) the synthetic setting, one assumption-matched anomaly type per dataset, favors simply selecting the matching detector.
- The method is essentially a weighted ensemble. By Eq. 3 and Lemma 1, the EG weights reduce to a softmax over each detector's estimated AUC, differing from the "select estimated best" and "AUC reweighting" baselines only in the softmax temperature, which is not ablated.
- The "multi-agent" and "LLM agents" framing is overstated. The detectors are standard statistical models, they do not interact, and LLMs only appear as optional components in the appendix.
- A family-balanced uniform baseline is missing. The pool contains several detectors from the same family, so plain uniform averaging, against which all gains are reported, is a weak reference.
- The method requires confirmed anomalies and falls back to uniform averaging otherwise; how much label information this represents across datasets is not discussed.
Questions for authors
Please consider reporting AUCPR, given the low anomaly ratios in several datasets.