- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper tackles the problem setting of learning the maximum tolerated dose in phase 1 cancer trials with continuous toxicity measures. For this the authors use two versions of Bayesian additive regression trees (BART) to also allow for uncertainty estimates of the dose-response function. Further, the authors formulate the problem setting then also as a Bayesian Reinforcement Learning setup. The proposed implementations are then benchmarked against three baselines and over different dose-response curves on simulated data.
Critical strengths
- The problem setup of learning the maximum tolerated dose in cancer doese escalation trails seems like an important application in the medical field. Using here Bayesian additive regression trees for the dose response modelling while also getting uncertainty estimates seems like a reasonable approach.
- The paper provides Dose Trial Lab, a software for visualizing the problem setup (I did not run the software), which might help if you are unfamiliar with the field.
Critical weaknesses
- The overall notation and problem setup is not entirely clear. E.g., Y(x) is not defined (does this imply the potential outcomes framework, a random variable, some arbitrary function?). In Eq.(1) the modelling choice of Eq. (1) e.g. the plausibility of a Gaussian distribution in this setting and implications should be explained properly. In iBART in Sec. 2.2, etc are not defined in the paper. These are examples but similar missing definitions and explanations carry throughout the whole paper.
- The writing style in large parts of the paper, in particular sec 2 and 3 is very hard to understand, the logical flow within and between sentences and paragraphs is often very hard to grasp. Even the motivation of the connection between section 2 and 3 is not clear to me after several reads. Then, the experiments section fails directly connect to the previous sections. The long RL Sec. 3 seems to be not evaluated in the main paper and only very limitedly in the appendix. Overall, also the experiments section reads more like an automatically generated report and does not follow a clear narrative.
- The methodological contribution seems very limited for an ICLR paper. Further, the clear benefit and necessity of the approach is not properly elaborated in the paper. This shows also in the novelty description in the introduction and in table 2 which reads more like a combination of methods and results, without showing the purpose or benefits of the choices. I think, overall this paper might be more suitable for a more tailored Biostatistics or ML for helathcare outlet, than for ICLR.
Questions for authors
What is the actual gain of the BART models over the 3PND baseline?
2 comments
Point-by-point responses by authors (2/2)
Q. How do Sections 2 and 3 connect, and what do the experiments evaluate?
A. (Sections 2–4, especially lines 209–216 and 263–265, and Appendix I, Table 4, of the revised manuscript.) Section 2 uses a lower quantile of the maximum tolerated dose (MTD) posterior to propose the next dose under escalation with overdose control (EWOC). Section 3 asks how giving that dose would affect later decisions. Two dose–toxicity curves can have the same MTD yet predict different responses for the next cohort. Rollout therefore uses the joint posterior of the curve and residual variance to simulate those responses, update the posterior, and determine what dose EWOC would propose next.
The experiments vary one component at a time. Section 4 holds the EWOC rule fixed and compares all five response models. Appendix I holds the response model fixed at 1PLD and compares EWOC with rollout. In that linear scenario, with an escalation cap of 7 dose units, rollout reduced the observed mean weighted loss by 55.8%–80.9% relative to EWOC across three loss profiles and two planning budgets (Table 4, lines 2155–2159).
We used 1PLD for this policy comparison because both its posterior update and its EWOC quantile have closed forms. Within rollout, Dose Trial Lab uses particle resample–move updates for 2PLD and 3PND and warm-started MCMC updates for iBART and mBART. Independent paths can run in parallel, but each dose decision within a path depends on the preceding cohort’s responses. Appendix I explains this computational cost in lines 2232–2243.
Q. What is the methodological contribution for a machine learning (ML) audience?
A. (Introduction, lines 76–82, Section 3, Proposition 1, and Appendix A.3, lines 866–880 of the revised manuscript.) Dose finding can be viewed as a sequential learning problem in ML because each dose we assign determines where we collect the next observation. We appreciate your point that this problem is also of interest to a biostatistics audience. Indeed, several papers on dose finding and personalized dosing have appeared at leading ML conferences. We added Appendix A.3 to discuss seven examples from ICML, AISTATS, NeurIPS, and ICLR, listed below.
Our contribution to the ML audience is to show how Bayesian trees can guide dose selection when we know only that mean toxicity is nondecreasing with dose. After each cohort, we use the continuous toxicity measurements to update the curve and its residual variation. Together, these give us a posterior distribution for the maximum tolerated dose (MTD), which we use to choose the next dose under overdose control. We also show how the escalation cap and the number of cohorts remaining limit how close the final dose can get to the MTD (Proposition 1).
References
Katz-Samuels, J., & Scott, C. (2018). Feasible arm identification. Proceedings of the 35th International Conference on Machine Learning, 80, 2535–2543. Article
Shen, C., Wang, Z., Villar, S., & van der Schaar, M. (2020). Learning for dose allocation in adaptive clinical trials with safety constraints. Proceedings of the 37th International Conference on Machine Learning, 119, 8730–8740. Article
Chien, I., Bruinsma, W. P., Gonzalez, J., & Turner, R. E. (2024). Safe exploration in dose finding clinical trials with heterogeneous participants. Proceedings of the 41st International Conference on Machine Learning, 235, 8436–8467. Article
Lee, H.-S., Shen, C., Jordon, J., & van der Schaar, M. (2020). Contextual constrained learning for dose-finding clinical trials. Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics, 108, 2645–2654. Article
Lee, H.-S., Shen, C., Zame, W., Lee, J.-W., & van der Schaar, M. (2021). SDF-Bayes: Cautious optimism in safe dose-finding clinical trials with drug combinations and heterogeneous patient groups. Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 130, 2980–2988. Article
Demirel, I., Celik, A. A., & Tekin, C. (2022). ESCADA: Efficient safety and context aware dose allocation for precision medicine. Advances in Neural Information Processing Systems, 35, 27441–27454. Article
Yao, M. S., Bastani, O., Andersson, A., Biancalani, T., BenTaieb, A., & Iriondo, C. (2026). Knowledgeable language models as black-box optimizers for personalized medicine. Proceedings of the 14th International Conference on Learning Representations. Article
Point-by-point responses by authors (1/2)
First of all, thank you so much for reading our paper carefully. Your question about what the trees gain over 3PND helped us see which comparison needed to be clearer.
We have uploaded the revised manuscript for your review. We hope you will take a look, and we would welcome the opportunity to discuss the new results with you.
Q. What is the actual gain of the BART models over 3PND?
A. (Table 1 and Section 4.3, lines 445–465 and 469–483 of the revised manuscript.) The clearest gain was on the piecewise-linear curve, where both trees estimated the maximum tolerated dose (MTD) more accurately and exposed fewer patients to dose-limiting toxicities (DLTs). Under the same EWOC dose rule, the mean relative absolute error (RAE) of the final dose was 9.97% with the power-law 3PND model of Lee (2023), 3.02% with iBART, and 3.00% with mBART. The paired mBART-minus-3PND difference was −6.97 percentage points (95% Monte Carlo interval [−7.00, −6.94]). The mean DLT count also fell from 3.86 per trial with 3PND to 2.02 with either tree. Both trees improved accuracy and reduced DLTs on the exponential curve as well. The gain depended on curve shape. In the original experiment, 3PND estimated the MTD more accurately than either tree on the quadratic and square-root curves.
We also doubled the residual standard deviation from 0.1 to 0.2 while keeping the true MTD at 50. Across 50 paired trials per curve, both trees had lower mean RAE than 3PND on the piecewise-linear, square-root, exponential, and logarithmic curves. All eight pointwise 95% Monte Carlo intervals for these differences lay below zero. On the exponential curve, both trees also reduced DLTs and above-MTD assignments. On the square-root and logarithmic curves, the gain in accuracy came with more DLTs (Figure 3).
The higher-variability experiment also included the linear dose finders 1PLD and 2PLD described by Lee et al. (2022). Both trees had lower mean RAE than either linear model on all six nonlinear curves. On the square-root curve, for example, mean RAE was 21.59% with 1PLD and 34.70% with 2PLD, compared with 9.99% with iBART and 9.49% with mBART. On the linear curve itself, 1PLD had the lowest mean RAE (2.28%). Figure 4 shows the paired comparisons with all three parametric models.
References
Lee, S. Y. (2023). A flexible dose-response modeling framework based on continuous toxicity outcomes in phase I cancer clinical trials. Trials, 24, 745. Article
Lee, S. Y., Munafo, A., Girard, P., & Goteti, K. (2022). Optimization of dose selection using multiple surrogates of toxicity as a continuous variable in phase I cancer trial. Contemporary Clinical Trials, 113, 106657. Article
Q. What does Y(x) denote, why use a Gaussian likelihood, and what do the tree symbols mean?
A. (Sections 2.1–2.2, lines 92–94, 121–126, and 130–140 of the revised manuscript.) Y(x) denotes a patient’s random, continuously measured toxicity response at assigned dose x. The trees model how mean toxicity changes with dose. As in continuous-response BART (Chipman et al., 2010) and the continuous-toxicity dose-finding model of Lee (2023), we use Gaussian errors with a common variance across doses. This is a working assumption for approximately symmetric residuals with comparable spread across dose levels. It allows us to use both the fitted mean and the residual spread to estimate the probability that a patient’s response reaches or exceeds the dose-limiting toxicity (DLT) threshold.
Section 2.2 now defines the tree notation. The function hj gives the contribution of tree j to the mean response. For iBART, Bk is the kth dose interval, and gk is the value of an unconstrained ensemble draw on that interval. We project these values onto a nondecreasing sequence so that the estimated mean toxicity can stay level or increase as dose increases.
Some of the notations were originally introduced and defined in the Appendix to accommodate the conference’s strict page limit. In the revised manuscript, we have added these definitions to the main text since we have one more page allowed. We thank the reviewer for this helpful suggestion, which has improved the clarity of the paper.
References
Chipman, H. A., George, E. I., & McCulloch, R. E. (2010). BART: Bayesian additive regression trees. The Annals of Applied Statistics, 4(1), 266–298. Article
Lee, S. Y. (2023). A flexible dose-response modeling framework based on continuous toxicity outcomes in phase I cancer clinical trials. Trials, 24, 745. Article