- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the impact of selectively deleting time series observations on classification under a fixed missing data budget. TG-SMA uses Gumbel relaxation, cross-entropy feedback, and per-sample Top-k projection to search for missing locations, while employing structural regularization to encourage contiguous missing values; NES-Mask provides query-based search for non-differentiable classifiers. The authors generate masks on top of Mean or Zero proxy imputers, then compare different imputation methods while keeping the masks fixed, and propose MID, which fuses numerical and missing indicator features and constrains consistency between complete and missing view predictions. The experimental setup covers ten datasets, seven imputation methods, and four classifiers; in the main experiment across six datasets, adversarial missing values caused greater loss than corresponding random missing values, and the main defense experiment using Chinatown–Informer demonstrated that MID can improve accuracy under fixed attack masks.
Critical strengths
1.This paper shifts the focus from the amount of missing data to the impact of missing locations on classification performance, demonstrating the significant effects of selective information loss through adversarial attacks under a strictly controlled missingness budget, which offers a novel perspective. 2.The fixed-mask experimental design effectively eliminates the influence of varying missing locations when comparing imputation methods, while the objective discussion of methodological limitations enhances the credibility of the experimental findings.
Critical weaknesses
- The paper does not sufficiently validate the specific contributions of the MID mechanism or its effectiveness against adversarial attacks.
- The attack evaluation lacks essential experimental details and protocols needed to ensure fair comparisons and reproducibility.
Questions for authors
1.Please clarify how the missingness masks are generated during MID training and testing, and further evaluate whether MID remains effective under adaptive attacks targeting the complete defended system. 2.I suggest conducting additional ablation studies on MID, including removing the gating mechanism, consistency loss, and missing-rate weighting, to assess the individual contributions of these components. 3.To ensure fair comparisons, I recommend controlling the number, length, and shape of missing blocks under the same missingness budget for both random and adversarial missingness. 4.Please provide the complete attack configurations and query budgets for TG-SMA and NES-Mask, and clarify whether missingness masks are shared across classifiers and whether padding positions in variable-length sequences are included in the attack. 5.Please provide further details on data splitting, preprocessing, and model training, explain the discrepancy in Heartbeat–TimesNet results between Table 1 and Figure 6, and report the mean and standard deviation over multiple independent runs.