- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Agentic Private Evolution for differentially private synthesis of structured workspace data such as email, chat, meetings, and documents. It extends Private Evolution with three components: a shared constraint module for maintaining consistent participants and context, a validation-and-repair agent for enforcing structural correctness, and constrained selection that preserves coverage of the released attribute table. The method is evaluated primarily on email and additionally on three other workspace modalities, using semantic fidelity, structural validity, downstream fine-tuning utility, and agreement between model/retrieval rankings on real and synthetic benchmarks.
Critical strengths
- The paper addresses an important limitation of existing DP text synthesis: sample-level semantic similarity is insufficient for structured agent environments. And the resulting improvements are substantial in benchmarks.
- The empirical validation goes beyond intrinsic similarity metrics and tests practical downstream utility. The paper includes matched-budget ablations, downstream fine-tuning on held-out real email, real-vs.-synthetic system-ranking comparisons, and transfer to chat, meetings, and documents.
Critical weaknesses
- Missing comparison with MAPLE. MAPLE is the most closely related prior work and the paper's method is based on MAPLE. The paper itself identifies it as particularly relevant. Without a matched-budget comparison, the empirical novelty of Agentic-PE is difficult to assess.
- Gap between theory and implementation lies on idealized assumptions such as Gaussian multi-scale variations and retained parents. The actual system uses LLM variations and does not retain parents the paper section 3 claims.
- Methodological novelty is one of my concern, as the paper's method seems like combining MAPLE + AugPE together with some tricks, which leads less novelty credit.
Questions for authors
- Could the authors provide a matched-privacy-budget comparison against MAPLE? This would materially affect my assessment of whether Agentic-PE provides a substantial improvement over the closest prior method rather than primarily over the older Aug-PE baseline.
- Could the authors clarify which parts of Theorem 2 are intended to apply to the implemented Agentic-PE system, given the differences in variation, parent retention, and admissibility assumptions? If the theorem is only intended as an analysis of an idealized variant, the claims should be scoped accordingly.
Response to reviewer 5BQa
Thank you for focusing on the two points that matter most for the paper's claims.
Q1. Comparison with MAPLE
Yes. At the same privacy budget, Agentic-PE improves substantially on a MAPLE-style baseline as well as on Aug-PE.
Setup. We ran the requested comparison at the same privacy budget as Table 1.
You noted that this comparison would affect your assessment. We hope these results show that Agentic-PE improves substantially on the closest prior method. In the revision, we will add this baseline to Table 1, report it next to the Aug-PE comparison in the abstract, and also run MAPLE with its AIM-based release.
Q2. Which guarantees apply to the implemented system
The guarantees the method relies on in practice, privacy and row coverage, hold for the implemented system. Theorem 2 analyzes an idealized variant. Theorem 2 assumes multiscale Gaussian variations, retained parents and oracle admissibility. The implementation uses two language-model variations without retained parents.
The implemented system moves in the direction the idealized analysis describes. From the first round to the last, recall rises from 0.352 to 0.414 and FID falls from 0.0493 to 0.0456. We will state the theorem's scope in the main text where §3.2 introduces the theory.
Thanks again for your review!