- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduce PAG-CBO for intervention optimization when causal structure is represented by a partial ancestral graph and intervention responses may be only partially identified. It uses observational bounds and confidence intervals from intervention data to decide which experiment to run next or stop, once it can certify that its recommendation is within of the optimum. The theoretical results concern safe pruning and localization of a standard kernel-bandit regret bound. Authors use synthetic causal models for experiments to certify proposed theorems.
Critical strengths
I think the motivation is reasonable: identifying every intervention response is unnecessary if the available information already determines a sufficiently good decision. The C1 example illustrates how informative partial-identification bounds can help beyond point identification alone.
Critical weaknesses
My main concern is that the experiments do not evaluate the procedure covered by the theoretical guarantees. Appendix D.2 acknowledges a missing factor in the intervention confidence coefficient, an unverified RKHS norm bound, and missing global error allocation across targets for the continuous observational bands. These differences directly affect certificate validity. I appreciate the empirical calibration study, but it does not establish whether the theoretically justified version remains useful at a reasonable intervention cost.
I think the novelty of theoretical contribution is limited. The identification and certificate results follow from existing identification guarantees and interval coverage, while the regret theorem adapts standard kernel-bandit analysis. In E0 to E4, roughly 95-99.9% of actions receive the uninformative outcome-range fallback, leaving little scope for observational pruning. The clearest success is the small discrete C1 example, where existing bound-aware methods can also use the same intervals.
I therefore remain unconvinced that this method offers a substantial improvement over simpler approaches.
Questions for authors
The authors should prioritize addressing the concerns raised in weaknesses.
Questions:
How does certification performance change when the implementation uses the confidence bounds and norm assumptions required by the theory?