- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper considers an interesting causal question under the federated setting: When does a centralised preference for a shorter sufficient evidence route survive federated evidence formation? In this paper, the authors prove that an unbounded 1:h:1 repair-cost separation that can persist through any prescribed bounded aggregation depth; and also characterize the formation depth under random federation. The experiments report readiness frontiers over aggregation depth, sample size and client allocation.
Critical strengths
- The paper proposes a clear, new, and interesting question.
- Each part is well organized and demonstrated, e.g., structural cost, formability, target-decision value, with both positive and negative results.
- The 1:h:1 construction with independently selectable depth and randomised lower bounds provides a rigorous worst-case picture.
- The experiments consider multiple seeds, making the results reliable, overall the experiments are extensive with grounded theories.
Critical weaknesses
- There are some assumptions in the paper, whether they can be satisfied in real world is not sufficiently demonstrated in the paper. Some of them can be idealized, such as Assumption 2.
- In the federated setting, communication and privacy issues are important. Those topics are not sufficiently discussed.
- Including some real world case study or examples can enhance the reliability and utilities of this paper.
Questions for authors
See above.
3 comments
Thanks for the detailed and candid response. My main concerns regarding the assumptions, communication and privacy, and real-world evidence have been adequately addressed. Given the novel and well-motivated question, the rigorous theoretical analysis with both positive and negative results, and the extensive experiments across multiple seeds and settings, I therefore maintain my positive assessment (3: Weak acceptance).
I do not raise my score further, for the following reasons, which concern the overall scope of the work rather than missing experiments:
- Gap between support readiness and decision reliability. The theory is developed at the support level under an idealized correct-or-abstain model. As your new results show, readiness does not by itself guarantee correct causal decisions in practice.
- Mostly worst-case and constructed results. The strongest results rely on carefully constructed instances, and the experiments use small Bayesian networks. It remains unclear how often these phenomena arise in realistic federated settings.
- Accessibility. The paper is dense and introduces many interacting notions. It also relies heavily on a long appendix, which makes it hard for the broader ICLR audience to follow.
Thank you for the thoughtful follow-up and for maintaining your positive assessment. We appreciate your clarification of the remaining concerns about scope and accessibility.
We agree that support readiness alone does not guarantee reliable causal decisions. Theorem 4 (Section 4.3) makes the distinction between full-repair readiness and decision value precise for limiting target-decision experiments, within the correct-or-abstain model and under a common graph-independent joint readiness-mask law. The finite-sample CI experiments in Section 5 separately examine the effects of estimated-label errors; these results do not constitute a general finite-sample reliability guarantee.
The stochastic formation laws in Theorem 2 and the sufficient preservation condition in Corollary 3 complement the constructed separations. Together, they identify conditions for reversal and preservation, without claiming how common reversals are in realistic federated deployments.
We have uploaded a revised manuscript. To improve accessibility, it includes a concrete hospital example, an explicit CHILD target in Section 3, a concise repair-selection procedure in Section 4.1, and finite-sample decision results with their scope explained in Section 5. We have also moved the detailed adaptive witness characterisation to Appendix C while retaining a short explanation of its role in the main argument. We hope these revisions make the paper easier to follow and would be happy to clarify any remaining questions.
Thank you for your suggestions on the practical aspects of the paper. We’ve responded in the rebuttal and will soon share a revised manuscript with an expanded practical discussion and an example using real measurements. We’d be happy to clarify anything you’d like to discuss further. If the response addresses your concerns and you find the additions improve the paper, we’d appreciate your considering a higher rating.