- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes BCA-GP for conditional dose-response estimation. The main idea is to separate the covariate baseline from the dose-response part, and then learn an adaptive dose kernel using residualized outcomes. The authors prove a baseline-shift invariance property and test the method on several semi-synthetic benchmarks.
Critical strengths
- The motivation is clear, and I think separating baseline effects from dose-response learning is a reasonable idea.
2。 The paper is generally well written and easy to follow. The baseline invariance result is also interesting.
- The experimental results look quite strong. BCA-GP outperforms all the reported baselines across the five benchmark tasks.
Critical weaknesses
-
The method relies on a fixed spline-based dose representation and a limited baseline function space. I am not sure how well it works when the true data generation process does not fit these assumptions.
-
I have concerns about the experiments. Even the basic GP performs better than VCNet and TransTEE on several benchmarks, which is quite surprising to me. Also, the authors did not use equal-budget hyperparameter tuning, and the semi-synthetic DGPs seem quite suitable for their method. I am not fully convinced by these comparisons.
-
The main theorem proves invariance to shifts within the chosen baseline space, but this does not really guarantee better CDRF estimation. The error bound also does not show consistency or explain why the adaptive kernel should improve estimation accuracy.
Questions for authors
-
What happens if the true baseline function is not well represented by the chosen baseline space? Can the authors test this?
-
Can the authors try more complex DGPs, especially with sharp or highly nonlinear dose-response functions? I think the current benchmarks are quite friendly to the proposed spline-based kernel.
-
I am quite surprised by the performance of VCNet and TransTEE compared with the basic GP. Could the authors explain this and provide results with better hyperparameter tuning for these baselines since I have tried to read the code but cannot see it via the anonymous link?
-
Why not compare with a standard semiparametric GP or universal kriging using the same unpenalized baseline?
-
The dose directions and kernel selection both use the same outcomes. Could this lead to overfitting? Is there any theoretical or experimental evidence that this adaptive selection is reliable?