- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper examines why source-domain concept erasure can succeed according to probe-based criteria while failing to preserve a detector operating point on an unseen target domain. The paper separates this failure into two proposed limitations, observation limitation and transport limitation. Finally, the paper distinguishes operating-point calibration from discrimination.
Critical strengths
-
The paper identifies a useful conceptual distinction that is often overlooked in concept-erasure evaluation. The authors emphasize that reducing recoverability of a nuisance label on source data does not establish attenuation of the target nuisance direction or preservation of a operating point.
-
The paper makes a serious effort to test alternative explanations. The manuscript also reports several hypotheses and corrections that did not survive stronger comparisons rather than presenting only favorable outcomes.
Critical weaknesses
-
The main paper is not sufficiently clear or self-contained to support its broad claims. The manuscript introduces so many related but non-equivalent quantities, such as probe accuracy, observation-channel energy, held-out capture, nuisance transmission, complement preservation, transport regret, FPR calibration, etc. However, it provides no overview diagram or compact protocol table explaining how these quantities relate, what information each one requires, and which claims they support.
-
The deployment evidence is specialized to one-class operating-point calibration and does not establish broad behavioral consequences of concept erasure. It is unclear whether source-side probe failure separates from downstream behavior in the same way for these settings.
Questions for authors
-
Format Issue The submission does not appear to preserve the official ICLR format. In particular, the required running header, “Under review as a conference paper at ICLR 2027,” is absent throughout the manuscript. In addition, the bibliography appears to use a visibly and measurably smaller font than the default template. The authors should use the unmodified official ICLR template style.
-
Reproducibility Does the submission commit to releasing code, nuisance trajectories, semantic partitions, target-adaptation splits, and all experiment manifests? The reproducibility statement describes the appendix but does not clearly promise a release.
-
Can the authors state the exact scope of the main claim in one sentence? In general, the paper is hard to follow and not well written.
-
Which results in the paper apply formally to nonlinear or higher-order erasure methods?
-
One Obliviator result is based on an incomplete run. Why is this result retained in the empirical comparison, and does removing it change any conclusion?
-
Can the authors provide a single overview figure or table mapping each experimental quantity to its role?
-
The boldface and interpretation of Tables 1 and 2 are insufficiently explained. Table 1 bolds only the rank-threshold entries. Please state whether bold denotes nominal order-statistic validity, the best matched-budget result, or another criterion.
4 comments
Response to Reviewer UBkR (1/2): format, clarity, reproducibility, scope
Please see our general comment above for a summary of the revision.
You are right that the submitted version made the central argument harder to locate than it should have been. We have made substantive presentation changes rather than only adding explanations in the appendix.
Format (Q1). The revised PDF restores the running header, "Under review as a conference paper at ICLR 2027", on every page and uses the template's default bibliography size. The main paper ends on page 10, within the discussion-stage limit; the reproducibility and AI-use statements, references, and appendices follow it. We also corrected the figure-legend overlap raised by another reviewer.
The claim in one sentence (Q3). For erasers whose domain signal is estimated from source-domain first moments, removing that signal neither reveals the content-dependent nuisance response that was averaged away nor determines the target-relevant subspace; in our one-class detection experiments, this means that source-side erasure alone does not reliably preserve the target FPR operating point, while threshold adaptation and feature adaptation address different deployment objectives. The revision states the main claim in this form at the end of the introduction (the wording there differs slightly).
A readable map of the paper (W1, Q6). A new Table 1 in Section 3 organizes the quantities by the question they answer and the information they require. The important separations are: domain-probe accuracy tests recoverability; nuisance transmission tests attenuation of a measured direction; capture and regret test geometric match; and FPR, TPR and AUROC test what the detector actually does. None of these quantities alone certifies the next one. Sections 4–7 now each open with their claim and its evidence, and the diagnostic-to-intervention procedure is in Appendix C.4.7.
Scope of the deployment evidence (W2). We agree that the deployment evidence is specific to one-class operating-point calibration, and the title, abstract and main claim are scoped to it; we make no claim about classification or generation. What is not tied to the detector: the observation identity and its finite-sample bias, transport regret, and Theorem 3 are statements about statistics and subspaces, and the order-statistic and ROC facts hold for any scalar score. The operating-point results are replicated for residual, Mahalanobis and kNN detectors (Appendix C.2.4).
Reproducibility (Q2). The new statement makes an explicit commitment to release the experiment code, controlled nuisance trajectories and generation scripts, semantic partitions, target adaptation and evaluation splits, and per-experiment configuration, seed and feature manifests, together with pinned upstream commits and patches. Derived medical features are subject to the relevant dataset licenses; extraction scripts will be provided in any case. This is a commitment in the revised manuscript, not a claim that the artifacts are already public.
Response to Reviewer UBkR (2/2): theoretical scope, omitted run, tables
Three remaining points deserve a precise answer.
Which results apply to nonlinear or higher-order erasure (Q4)? The revision adds a formal-scope table (Appendix C.4.8). The observation decomposition in Proposition 1 applies to first-moment channels such as LEACE with one-hot domain labels. Equation 3 and the cross-fitting correction concern estimation of grouped-mean operators and do not depend on the eventual eraser. The differential transfer inequality applies to differentiable erasers through their Jacobians. The transport-regret results, including the worst-case lower bound of Theorem 3, concern rank- projector selection rules, even when those rules use source statistics of arbitrary order; they do not prove a limit for every nonlinear transformation. Order-statistic calibration and ROC invariance apply to any fixed scalar score. The empirical claims about MANCE++ and DANN remain descriptive.
Why was Obliviator in the original table (Q5)? We originally included a partial run for transparency, but that presentation implied a comparison the experiment did not support. We have removed it from all comparative tables and conclusions. Appendix C.3.5 documents the incomplete optimization, including an SVD failure and the subsequent collapse of the representation before the method's stopping rule was met. The LEACE, MANCE++ and DANN results are unchanged, and the claims of the revised paper do not rely on Obliviator.
What did boldface mean (Q7)? Your references to the original Tables 1 and 2 correspond to Tables 3 and 4 in the revision, because the paper now begins with an overview table and a nonlinear-outcome table. In revised Table 3, bold marks the lowest calibration error among the matched-budget arms only where the rank threshold is a nominally valid order statistic, at . At and the cutoff is clipped to the maximum observed score, with expected FPR rather than 0.05, so those entries are not bolded; the geometry-all arms use more data and are excluded from that comparison. Revised Table 4 has no bold entries. These conventions are now stated in the captions.
We agree that a source-statistic result, a subspace theorem and an observed detector outcome should not be treated as interchangeable. The main-text overview and the scope table are meant to let the reader see exactly which statement each section makes.
Response to the rating change
Thank you for the note, and we apologize that our responses came late in the discussion period. We have now uploaded a revised PDF and posted a general response and point-by-point replies to all three reviewers. The revision addresses each of your questions: the official template with the running header and default bibliography size (Q1), an explicit release commitment (Q2), a one-sentence statement of the main claim (Q3), a formal-scope table for nonlinear and higher-order erasers (Q4), removal of the incomplete Obliviator run (Q5), an overview table of all quantities and the information each requires (W1, Q6), and stated bold conventions (Q7). We would be grateful if you would consider the revised version before finalizing your assessment.
considering the low quality of this work, and no response to all reviewers, I lower my rate from 2 to 1