- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Adaptive Decision-Boundary Probing Distillation (ADBD). Starting from an adversarial example generated using coordinated teacher-student information, ADBD rescales the perturbation along the same direction. If the teacher misclassifies the adversarial point, the method moves toward the clean input to find a teacher-correct point near the boundary; if the teacher remains correct, it extends the perturbation to probe a farther correct region. These query points provide supervision about the teacher's local decision behavior. Experiments on CIFAR-10, CIFAR-100, and SVHN report improvements over several robust-distillation baselines under PGD, C&W, and AutoAttack.
Critical strengths
-
The motivation is clear: a robust teacher is not uniformly reliable on student-generated adversarial examples, so supervision should depend on the teacher's sample-specific behavior.
-
The evaluation includes two public robust teachers, two student architectures, three datasets, several attacks, and comparisons with ARD, IAD, RSLAD, AKD, AdaAD, and SmaraAD.
-
ADBD consistently improves robust accuracy in most configurations. For example, it reaches approximately 54.8% AutoAttack accuracy in a CIFAR-10 ResNet-18 setting. Three-seed results and objective ablations support the contribution of query-point supervision.
Critical weaknesses
ADBD introduces additional teacher evaluations and per-example bisection, but the paper does not systematically report wall-clock time, teacher-forward counts, memory use, or computational overhead relative to the baselines.
Questions for authors
1.Based on existing training logs, how many additional teacher forward passes and how much training time does ADBD require relative to AdaAD or SmaraAD? A large cost would lower my assessment, whereas modest overhead would strengthen the practical contribution.
- I am curious about the comparison between the proposed method and existing dual-teacher robustness distillation.
Dear Reviewers,
As the discussion deadline (November 18, AoE) approaches, please review the authors’ rebuttal if you have not already done so and post a follow-up confirming that you have read it and indicating whether your main concerns have been addressed.
Best, AC