- Rating
- 4
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper studies performative policy learning when agents strategically modify their features in response to a deployed policy. Its central idea is to represent the policy’s influence through an evaluation vector containing treatment probabilities at feasible feature choices. This enables learning a differentiable behavior model and estimating performative policy gradients, connecting causal policy learning with optimization under endogenous distribution shifts.
Critical strengths
- Clear motivation and formulation. The paper motivates the problem well and presents an accessible, clearly posed setting.
- A valuable conceptual connection. The evaluation-vector representation provides a compelling bridge between causal inference, strategic behavior, and performative prediction, without requiring a prespecified parametric utility model.
- Simple and intuitive gradient decomposition. Equation (2) is a powerful tool that clearly separates the direct policy effect from the environment shift effect .
- Convincing experiments. The synthetic and semi-synthetic results show substantial improvements over the baselines. I appreciate the noisy-response, behavior-model, and discretization experiments, alongside diagnostics of the performative correction.
Critical weaknesses
- The theoretical guarantee could be stronger. Theorem 4.4 controls , with residual error from estimation bias and batch noise. This establishes approximate stationarity of some iterate, rather than a vanishing optimality gap , where is the best achievable performative value. For nonconcave neural policies, stationary points can be suboptimal. The authors acknowledge this distinction; an explicit value guarantee under additional structure would strengthen the analysis.
- The theorem assumes uniformly accurate behavior estimation in an RKHS norm that controls derivatives. It remains unclear when the training procedure and warm-up ensure this condition. Deterministic best responses can also violate the smoothness and positivity assumptions, leaving a gap between the guarantee and the main experiments.
Questions for authors
- In the smooth multinomial-logit experiment, can you compare learned and oracle performative gradients, including directional agreement?
- At a fixed interaction budget, would deliberately perturbing warm-up policies improve response-gradient estimation?
- How robust are the gains to heterogeneous manipulation costs and weaker relationships between manipulable features and outcomes, particularly in the lending experiment?
Dear Reviewer,
Thank you for your time and for the comments provided in your initial review.
We have carefully addressed your concerns through detailed clarifications, additional experiments, and revisions to the manuscript. As we have not yet had the opportunity to hear your thoughts on these updates, we would sincerely appreciate it if you could revisit our responses and reconsider your assessment in light of the new evidence.
If any concerns remain unresolved, we would be more than happy to provide further clarification.
Thank you again for your time and consideration!