- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2(+1)
- Soundness
- 2(−1)
Read review
Paper summary
As best as I can piece together through the paper's very dense presentation, the work studies adaptive update clipping for federated learning under client-level local DP. It argues that existing heuristics all fail "silently", meaning the clipping radius can become decoupled from the true data in an indetectable way. Then the authors propose three "design laws" that function as axioms that an acceptable adaptive clipping mechanism should satisfy and propose a new algorithm. They validate it on some small-scale federated tasks, comparing to existing approaches.
Critical strengths
The conceptual framework and identifying of flaws in existing approaches may be of potential value. Although I had extreme difficulty understanding the work on my own, my AI tool praised the paper's "radical (almost obsessive) empirical honesty", and said that the negative results are genuine and important, although of limited practical utility.
Critical weaknesses
The paper is so telegraphic as to be essentially unreadable (by humans). Let's begin with the abstract. Rather than providing an accessible overview of the work, it reads like a severely compressed log of experiments, full of very precise claims, many of which refer to concepts that have not yet been defined. At first, I was able to guess the intention ("client level" seems to imply federated learning, although that has not been stated, is plausibly assumed to be the number of parameters) but as it went on I became bewildered.
- "The design settles above in every CNN and MLP run at ." What is ? What is ? Why is settling above that an achievement?
- "Under one accounting, the released-norm plug-in rule diverges in every cell (6.9–12.4% final accuracy against 19.9–38.5%)" What is the "one accounting" and is it one that matters? What is the "released-norm plug-in rule"? What is a "cell"?
The paper continues in this extremely telegraphic style. To be clear, the problem is not density, per se, but that throughout the paper statements are made that are literally incomprehensible unless one has context on the entire work at once, including the appendices.
It is possible there is scientific value in this work for AI agents to process, but it is nearly useless as a communication tool for humans.
Questions for authors
I have no questions. Even if the authors were able to clarify the value of the paper in rebuttal, I would not recommend this paper for acceptance without a complete rewrite for clarity and human readability.