- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MEDT proposes an engineering-reasonable expert committee framework for streaming fraud detection under delayed supervision, and achieves the best PR-AUC among online methods on W26. However, its baselines are outdated, its introduction and literature review are insufficient, it is validated on only a single dataset, its core components lack novelty and independent significant gains, and its inference latency of 7.96 seconds severely contradicts its streaming-oriented positioning.
Critical strengths
MEDT retains temporally differentiated experts, reassesses predictive competence from observable delayed feedback, and selects high-scoring eligible experts for committee prediction. A frozen historical anchor provides a standing reference, and committee probabilities are combined through anchor-stabilized probability fusion. On the IEEE-CIS-based W26 controlled-perturbation stream, MEDT achieves a PR-AUC of 0.4628, 17.0% above the strongest evaluated online baseline. Removing the temporal-expert component reduces PR-AUC by 0.0436, while replacing soft fusion with hard voting reduces it by 0.1023; both contrasts have Holm-corrected p < 0.05 in the planned within-stream paired tests.
Critical weaknesses
- The baseline selection is severely outdated, which directly weakens the persuasiveness of the claim "17.0% above the strongest evaluated online baseline."
- The introduction is poorly presented, and the literature review is insufficient, making it difficult to read.
- The dataset validation is limited to a single dataset, lacking real-world generalizability.
- The motivation of the proposed method is not sufficiently clear, and the core components of MEDT have similar ideas in the literature after 2020.
- Table 15 shows that MEDT has a Predict latency of 7.96s, the highest among all methods in the table, two orders of magnitude higher than XGBoost (0.06s) and about 26× higher than Streaming HGB (0.30s), which further weakens its contribution given the high sensitivity to latency.
Questions for authors
- Add online / delayed-feedback / continual fraud detection baselines from 2022–2025 to re-verify whether the 17.0% lead still holds.
- Demonstrate the independent significant gain of at least one core component: at least one of the competence estimator, selection rule, or anchor must significantly outperform its alternative.
- Validate on multiple public fraud datasets, or at least provide cross-dataset / cross-time-period generalization experiments to show that the conclusions do not depend on the specific construction of W26.