- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Addressing the lack of provable robustness guarantees in existing ECOC (Error-Correcting Output Codes) classification models, this paper proposes a robustness certification framework that combines per-bit certification and decoding-aware aggregation. It also designs two certification methods, ECOC-HD and ECOC-SD, to compute certified robustness radii for ECOC classifiers. The authors conducted experiments on multiple image classification datasets. The results show that, compared to traditional randomized smoothing methods, this approach achieves a larger certified radius and higher certified accuracy, and demonstrates greater robustness in certain adversarial attack experiments.
Critical strengths
- This paper addresses the lack of structure-aware robustness certification in existing ECOC classification models. The research motivation is clear, and the work holds both theoretical and practical significance.
- Combining per-bit certification with decoding-aware aggregation, the paper proposes ECOC-HD and ECOC-SD for hard decoding and soft decoding, respectively, and provides corresponding theoretical analyses and certification algorithms, offering a degree of methodological novelty.
- The paper evaluates certified robustness across multiple datasets and models, and through adversarial attack experiments, parameter analysis, and computational overhead tests, the experimental coverage is relatively comprehensive.
Critical weaknesses
- Some of the results of the Targeted ECOC Attack do not fully align with the authors’ conclusions.
- The baseline descriptions in Section 4.1 and Table 2 appear inconsistent.
- The coverage of recent related work is insufficient, particularly regarding studies on randomized smoothing and structured output robustness certification in recent years.
- The experiments primarily compare the method with classical randomized smoothing approaches, lacking comparisons with other representative certification methods.
- There is a lack of ablation experiments targeting core components.
Questions for authors
Q1. In Table 2, the Targeted ECOC Attack achieved a lower Robust Accuracy on CIFAR-10 than the C&W attack, which does not fully align with the paper’s conclusion that this attack offers no additional advantages. Additionally, the baseline entry in the Targeted ECOC Attack column corresponds to a targeted C&W attack rather than the same attack applied to the proposed methods. Please further explain these result.
Q2. There appears to be a discrepancy between the description of the Baseline in Section 4.1 and that in Table 2. Clarify the Baseline settings across different experiments.
Q3. One of the paper’s main contributions is the use of Decoding-aware Aggregation to combine per-bit certification results into an overall robustness guarantee; however, the current ablation experiments primarily focus on codeword length and noise parameters.
Q4. We suggest that the authors conduct a more comprehensive literature search and supplement the paper with recent research (particularly from 2024–2026) related to Randomized Smoothing, ECOC, and structured output robustness certification.
Q5. It is recommended to further consider representative methods such as SmoothAdv and MACER, or to discuss their compatibility with the proposed framework, and, conduct fair comparisons to more fully evaluate the advantages of the proposed method.
We sincerely thank the reviewers for their time and effort, and greatly appreciate their valuable feedback and suggestions. After careful consideration, we have decided to further revise the paper and withdraw it from this submission.