- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the design of efficient adaptive experiments with the existence of right censored outcomes, which is an important topic in causal inference and survival analysis. It first derives the semiparametric efficiency bound for the average survival effect curve, then obtain an efficiency-optimal allocation policy by minimizing the variance bound. Based on this, it proposes the adaptive survival estimator (ASE) that adaptively learns the optimal allocation policy from the streaming data, and estimates the average survival effect curve sequentially. Theoretical analysis shows its consistency and asymptotic normality, using martingale CLT to handle the adaptively collected data. Finally, they demonstrate the empirical advantages of their methods over baselines, using several synthetic and semi-synthetic experiments.
Critical strengths
-
This paper proposes a principled framework for optimizing treatment allocation with right censored outcomes. The motivation and flow of the methodology are very easy to follow.
-
This paper provides a consistent estimator (ASE) for the average survival effect curve. The asymptotic normality of the estimator is proved using martingale CLT to handle the adaptive data structure.
-
The assumptions of the theorems are clearly states and well motivated. The authors also provide enough explanations for why these assumptions are needed and reasonable.
Critical weaknesses
-
The novelty of this paper is limited, and the proposed method should be considered as a methodological extension rather than a substantially new contribution that reaches the ICLR publication standard. There is already substantial related work (Zhang et al., 2023; Wei et al., 2023; Cook et al,. 2024) that proposes adaptive treatment allocation frameworks to specific statistical objectives, and demonstrates the statistical guarantees for post-hoc estimation using martingale CLT. On the other hand, the treatment allocation objective, i.e., the semiparametric bound for right censored outcomes, has also been developed before (Westling et al., 2024). Therefore, this paper merely combines two established lines of research in a straightforward way, without introducing substantially new methodological or theoretical techniques.
-
Some theoretical details appear to be inconsistent, which raises concern about the soundness of the paper. For example, the Optimal treatment allocation (line 241) assumes that the policy is clipped at fixed alpha and 1-alpha, yet equation 11 uses clipping bounds that approach 0 and 1 asymptotically. The effect of accumulated estimation bias is also not well justified. For example, in the proof of theorem 6.3, equation 69 does not generally holds without stronger assumptions.
-
Some experiments claims appear to be inconsistent with figures, which also raises concern about the reliability of the experiments. For example, the authors claim that "Our ASE achieves a relative MSE of approximately 1.05×of the oracle at R= 2000, which nearly matches oracle performance despite using estimated nuisances," while the figure 3 (a) shows that the MSE of ASE (Ours) is much larger compared to the oracle. The experiments are also not sufficient. There are only two experiments, both use simulated censoring, and both set high censoring probability for the control group at first time point.
-
The mathematical presentation is too dense for Section 5 and 6.
Reference
- Zhang, W., Zhang, Z., & Liu, A. (2023). Optimizing treatment allocation in randomized clinical trials by leveraging baseline covariates. Biometrics, 79(4), 2815–2829.
- Wei, W., Ma, X., & Wang, J. (2023). Fair adaptive experiments. Advances in Neural Information Processing Systems, 36, 19157–19169.
- Cook, T., Mishler, A., & Ramdas, A. (2024). Semiparametric efficient inference in adaptive experiments. Proceedings of the Third Conference on Causal Learning and Reasoning, 236, 1033–1064.
- Westling, T., Luedtke, A., Gilbert, P. B., & Carone, M. (2024). Inference for treatment-specific survival curves using machine learning. Journal of the American Statistical Association, 119(546), 1541–1553.
Questions for authors
-
Please refer to my comments in Critical Weaknesses. The clipping bound of the optimal treatment allocation appears to be inconsistent. Which one should we use in practice and in theory? Should we assume that the policy is clipped at fixed and , or at and , where as the sample size increases?
-
Please refer to my comments in Critical Weaknesses, I found a potential inconsistency in the presentation of the experimental results. I encourage the authors to carefully revisit the experimental conclusions.
-
I encourage the authors to do some real-world data analysis with real survival data, instead of using simulated censoring data.
4 comments
> W2 + Q1: Clipping of the allocation policy and accumulated estimation bias
Thank you for these careful observations and for the opportunity to clarify the clipping rules and the control of the accumulated bias.
1. Clipping of the allocation policy. Both clipping rules are special cases of the truncation in Eq. (11). The fixed interval corresponds to the constant schedule , while the shrinking interval corresponds to .
In theory, the target of the adaptive policy is the unclipped optimal ratio . In Proposition 6.4, we now assume that this ratio lies in for some , together with the variance non-degeneracy condition (see also our response to Reviewer W5Qs, Q4). Under this condition, the clipping in Proposition 4.3 is inactive, so coincides with the unclipped ratio, and both truncation rules converge to the same as soon as .
In practice, a fixed can be used whenever a lower bound on the optimal allocation is known, for example from design or ethical constraints. This is the choice in our experiments (, Appendix K.2), where the oracle optimal ratio lies strictly inside in both settings. When no such bound is available, the shrinking schedule ensures that the clipping interval eventually contains .
To cover both cases, we have relaxed Theorem 6.3 to any non-decreasing schedule with , which includes constant . The proof is unchanged, since it only uses .
2. Accumulated estimation bias. Thank you also for the careful reading of Eq. (69). To make the cumulative step fully rigorous, we have stated the rate conditions of Theorem 6.3 in expectation:
and analogously for . By Eq. (68) and the Cauchy–Schwarz inequality, this yields , and hence
since . By Markov’s inequality, the accumulated bias is therefore . We have applied the same in-expectation conditions throughout the proof of Theorem 6.3, including the conditional variance step and the martingale fluctuation term.
Action: We have (i) clarified the relation between the two clipping rules after Theorem 6.3; (ii) relaxed the truncation schedule in Theorem 6.3 to include constant ; (iii) stated the policy condition of Proposition 6.4 on the unclipped optimal ratio; and (iv) stated the rate conditions of Theorem 6.3 in expectation and updated Eq. (69) and the corresponding steps in Appendix F.4.
> W3 + Q2: Consistency between the text and Figure 3
Thank you for carefully checking our experimental results. The numbers stated in the text of Section 7 referred to an earlier version of our synthetic experiment, and we have updated them now. Figure 3 reports the final results, and we have corrected the text accordingly: at , ASE achieves a relative MSE of approximately the oracle, compared with for ASE-NA and for A2IPW-Naïve. Importantly, our conclusions are unchanged: ASE achieves the lowest error among all feasible estimators, and the censoring-aware allocation outperforms both uniform randomization and the censoring-agnostic A2IPW-Naïve.
Action: We have corrected the numerical statements in Section 7 to match Figure 3.
> W4: Clarity of Mathematical Presentation
Thank you for this helpful suggestion. We have expanded the math in Sections 5 and 6 to improve readability and provide clearer intuition behind the key mathematical formulations and theoretical results, while keeping the detailed technical derivations in the Appendix.
Action: We have revised Sections 5 and 6 to improve the clarity of the mathematical presentation.
> Q3: Real-world survival data
Thank you for this suggestion. To strengthen the empirical evaluation, we have added new experiments based on the ACTG 175 randomized clinical trial from SurvHTE-Bench [1], which combines the real covariates of trial participants with semi-synthetic survival outcomes generated by the benchmark. The table reports results over replications at , with MSE and coverage averaged over the benchmark’s evaluation horizons.
| Method | MSE | Coverage |
|---|---|---|
| ASE | ||
| ASE-NA | ||
| ASE-MS | ||
| A2IPW-Naïve | ||
| Plug-in | ||
| Plug-in-NA |
We highlight two findings: Inference remains valid under adaptive allocation with real covariates. ASE attains coverage, in line with Theorem 6.3. In contrast, the plug-in estimator severely undercovers, and ASE has a lower MSE under the same design. Note that the A-optimal allocation targets the variance of the efficient estimator and is therefore not designed to benefit the plug-in estimator, which relies solely on the fitted outcome model. The gain from adaptive allocation matches our theory quantitatively. In this setting, the optimal allocation is close to 1:1 (mean ). Accordingly, the realized MSE ratio of ASE-NA to ASE is . Settings with efficiency gains on the benchmark under differential dropout are discussed in our response to Reviewer W5Qs (W2 + Q1).
Action: We have added the new experiments based on ACTG 175 to Section 7, with further details in Appendix J.3.
References
[1] Noroozizadeh, S., Shen, X., Weiss, J., & Chen, G. H. (2026). SurvHTE-Bench: A benchmark for heterogeneous treatment effect estimation in survival analysis. In International Conference on Learning Representations.
Dear Reviewer,
The discussion period is nearing its end, and we haven’t yet seen a reply from you. We encourage you to respond to the authors’ comments, especially if you have further questions about points that may affect your assessment.
Thank you for taking the time to engage in the discussion.
Best,
Your AC
Response to reviewer 6ySG
Thank you for your valuable evaluation of our paper! We took all your comments to heart and improved our paper accordingly. All changes are highlighted in blue in the revised PDF.
> W1: Theoretical novelty beyond existing adaptive experimentation and survival inference
Thank you for this thoughtful assessment and for highlighting the connections to existing work. Our framework builds on adaptive designs for fully observed outcomes [1, 2, 3] and on semiparametric survival inference under a fixed assignment [4], from which we inherit the Neyman-type allocation structure and the martingale CLT. However, two key steps do not carry over directly under right censoring, which is why we derive a new method for our task.
Efficiency bound as a function of the allocation policy. The survival literature [4] characterizes efficiency under a fixed assignment, whereas experimental design requires the bound as a function of π. Because of this, the results from the literature cannot be transferred to our case. As a remedy, we derive Theorem 4.1, which provides this in closed form, thereby recovering the Neyman allocation exactly without censoring (Section 4). With censoring, the optimal allocation shifts even when both arms share the same censoring hazard (Figure 2). Moreover, the variance target V^a is an explicit function of the hazard nuisances already estimated for the EIF, so no additional variance regression is needed (Remark 5.1).
Inference with an estimated censoring mechanism. In [1, 2, 3], the propensity is chosen by the experimenter, so the AIPW score is conditionally unbiased given the history. Under right censoring, the censoring mechanism is unknown even in a randomized trial and must be estimated. Hence, the estimated score is no longer conditionally unbiased. To deal with this, our analysis therefore shows that the first-order nuisance errors cancel after conditional expectation, yielding the bias bound ∣E[mt,r∣Hr−1]∣≲(erS)2+erSerG (Eq. (68)), and controls the remainder fluctuation under the shrinking truncation (Eq. (81)). This also leads to a robustness structure specific to censoring: ASE remains consistent under censoring-model misspecification (Corollary 6.6) and is doubly robust in the no-ties setting (Appendix G).
We also kindly refer to our response to Reviewer grf1 for a summary of which components are inherited and which are new.
Action: We have added [1] and [2] to the related work, and added more elaborate comparison to Appendix B.
References
[1] Zhang, W., Zhang, Z., & Liu, A. (2023). Optimizing treatment allocation in randomized clinical trials by leveraging baseline covariates. Biometrics, 79(4), 2815–2829.
[2] Wei, W., Ma, X., & Wang, J. (2023). Fair adaptive experiments. In Advances in Neural Information Processing Systems, 36, 19157–19169.
[3] Cook, T., Mishler, A., & Ramdas, A. (2024). Semiparametric efficient inference in adaptive experiments. In Proceedings of the Third Conference on Causal Learning and Reasoning, PMLR 236, 1033–1064.
[4] Westling, T., Luedtke, A., Gilbert, P. B., & Carone, M. (2024). Inference for treatment-specific survival curves using machine learning. Journal of the American Statistical Association, 119(546), 1541–1553.