- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates membership inference attacks (MIAs) and defenses. As far as I understand, the paper seeks to benchmark various MIAs and defenses and attempts to explain their performance differences across different data distributions. Specifically, it proposes a geometric interpretation of membership leakage by categorizing datasets into three regimes, investigates how different classifier heads affect privacy leakage, and proposes a density-based classifier head and a dual-track defense.
Critical strengths
Rigorously benchmarking different MIAs and defenses is a valuable effort. The paper attempts to provide a principled interpretation of why different methods perform differently across data distributions, which is a potentially interesting direction. If the authors can improve the clarity and organization of the paper to better communicate their key findings and contributions, the work could become more valuable.
Critical weaknesses
This paper reads like an AI-generated manuscript:
-
It contains frequent and unnatural uses of semicolons and parentheses, which are stylistic features often associated with AI-generated writing.
-
There are many nonstandard terms, such as "read-out", "manifold health", "shadow budget", "density head read","mixed distributions" that are directly used in the abstract and introduction without explaining their meanings, making it very difficult for readers to properly understand the key ideas of this submission
-
The introduction and method sections are highly fragmented and lack a clear logical flow. Even after reading through the entire paper, I still cannot clearly identify its key ideas/findings/contributions.
Given these issues, I find it difficult to give a positive assessment of the paper in its current form, as the unclear presentation prevents me from thoroughly understanding and evaluating the technical details. The paper requires substantial restructuring to establish a clear and coherent logical flow and to make its key ideas and contributions understandable.
Questions for authors
-
The proposed method seems to be largely built upon CRISP (Anonymous, 2026), which is cited as an unpublished work under review. However, the reference does not provide a URL or any other means of accessing the manuscript. Could the authors clarify the relationship between CRISP and the proposed method, particularly which components are inherited from CRISP and which constitute the novel contributions of this paper? It would also be helpful to provide an accessible reference to CRISP.
-
Could the authors more clearly distinguish the main contributions of the paper, particularly the relationship among the proposed geometric framework, the dual-track defense, and the density-based classifier head?
-
Some statements appear to be imprecise or inappropriate. For example, "samples are scattered points rather than manifold elements" (line 94) is questionable, as scattered samples can still lie on an underlying manifold. The authors should carefully review the entire paper and clarify the intended meaning of such statements.