- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper utilizes the Jacobian matrix to reduce the amount of injected noise in downstream tasks under LDP, presenting a novel approach.
Critical strengths
Meeting the representation of high-dimensional data in LDP is a research hotspot
Using the Jacobian matrix to inject task-related noise is a novel approach
Critical weaknesses
The starting point of identifying the main relevant directions in tasks is not novel. I have seen it in covariance matrices, learning importance, and principal component analysis
Some descriptions are exaggerated or subjective
Questions for authors
see w
4 comments
I am pleased to maintain the positive score.
I am pleased to maintain the positive score.
Appreciation for the Reviewer's Constructive Feedback
We sincerely thank the reviewer for their positive assessment and continued support of our work. We greatly appreciate their thoughtful feedback, which has helped us improve the clarity and presentation of the manuscript.
Clarification of Novelty and Contributions
We thank the reviewer for the constructive feedback and for recognizing the novelty of using the Jacobian to guide task-aware noise allocation.
We agree that identifying important directions to improve utility is not a new concept, as prior studies have explored covariance-based, relevance-based, and principal-component-based approaches. We have therefore clarified that our contribution lies not in the general idea of identifying important directions, but in exploiting the Jacobian of a downstream model to identify task-sensitive subspaces and guide noise allocation under LDP.
We have also revised the manuscript to remove subjective or overly broad expressions and improve the precision and clarity of our descriptions.
These revisions have been incorporated into the revised manuscript and are highlighted in the Introduction (page 2, lines 61–80).
We sincerely thank the reviewer once again for the valuable feedback.
Response to Reviewer's Concerns
We are pleased to hear that the reviewer found our work interesting, and we sincerely appreciate their careful evaluation and constructive feedback.
We would like to address the reviewer's concerns and provide our detailed responses to each point below.
Weakness 1. Clarification of Our Contributions
We understand the reviewer's concern regarding the extent of our methodological novelty relative to prior work.
We acknowledge the important contributions of existing task-aware approaches, particularly the analytical encoder–decoder framework for linear tasks. Nevertheless, we would like to emphasize that there remains meaningful room for improvement under restrictive privacy budgets, even for linear task models. We believe that achieving consistent utility improvements under strong privacy constraints, without relying on substantial latent-dimensionality reduction or noise-dependent decoder shrinkage, remains an important research challenge.
Our main contribution is the introduction of a new task-aware approach that leverages global active and inactive subspaces to improve representation utility under LDP, with applicability to both linear and nonlinear downstream task models.
Beyond this methodological contribution, our approach offers several additional advantages:
Our experimental results demonstrate improved utility under restrictive privacy budgets without relying on substantial latent-dimensionality reduction or noise-dependent decoder shrinkage, including in linear regression settings where existing analytical task-aware approaches exhibit limited utility improvements. We provide a detailed analysis of these phenomena in our response to Question 1 of Reviewer oJD3, explaining how decoder shrinkage and latent-dimensionality reduction can arise in existing analytical task-aware approaches under restrictive privacy budgets.
Our approach naturally accommodates nonlinear task models, as further supported by additional experiments involving MLPs and Vision Transformers (Appendix A.11, page 51 of the revised manuscript).
To further clarify these contributions and distinguish our approach from prior work, we have expanded the Related Work section (pages 2–3, lines 94–111) of our revised manuscript.
Weakness 2. Overstated or Unsupported Claims in the Introduction
We thank the reviewer for pointing out that some claims in the Introduction were not sufficiently supported by the presented evidence. We agree that the scope of our claims should accurately reflect our theoretical results and experimental findings.
To address this concern, we have carefully revised the Introduction to ensure that our claims are appropriately supported by the evidence presented in the manuscript. Specifically, we now explicitly identify the approximate mechanisms that our approach outperforms in the evaluated settings, as well as the existing advanced LDP mechanisms to which our approach can be applied.
These revisions are reflected in the Introduction (page 2, lines 81–89) of our revised manuscript. We hope that these changes adequately address the reviewer's concern and improve the precision and clarity of our claims.
We sincerely appreciate the reviewer's constructive feedback, which has helped us improve the clarity, accuracy, and presentation of our work. We hope that our additional explanations, experimental results, and revisions adequately address the reviewer's concerns regarding methodological novelty and the scope of our claims.
We believe that our proposed approach makes a meaningful contribution to improving representation utility under LDP for both linear and nonlinear task models. We hope that these clarifications and revisions further strengthen the reviewer's positive assessment of our work.