- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Dependency-Aware Prescription Selection (DAPS), a backbone-agnostic decoder for frozen probabilistic recommenders, which uses two cross-fitted stages to calibrate candidate scores and construct a provisional prescription, and to refine these scores using set-conditioned context.
Critical strengths
The research problem addressed by DAPS is well-founded, its theoretical motivation is more robust than that of typical papers on modular combinations, and the experimental coverage is quite extensive.
In the introduction, the author explicitly points out that existing recommendation models for Western and traditional Chinese medicine primarily focus on improving the representations and prediction scores of candidate medications; however, these approaches ultimately require converting candidate probabilities into a prescription set of variable size.
Therefore, the core question is: How to convert candidate-wise probabilities into a better prescription set accounting for dependencies between candidates, the cardinality of the set, and external conflicts, without retraining the backbone model?
This framing is sound and offers a more specific focus than simply proposing a generic new medication recommendation framework.
Critical weaknesses
The paper has not fully demonstrated that the observed performance gains stem primarily from the highlighted "dependency-aware set decoding", rather than from other factors such as a more robust probability calibrator, additional supervisory models, or the optimization of the number of prescribed items.
All backbones are augmented with an additional, separately trained prediction refinement pipeline; therefore, authors must also address the following question: Do these performance gains stem from the dependencies, or from the re-learning and calibration of the original model's predictions?
Questions for authors
I am focused on two questions:
First, is the methodological innovation primarily a matter of complex system integration, or does it represent a truly unique and irreplaceable new decoding principle?
Second, are the experimental gains sufficient to validate the dependency-aware mechanism, as opposed to simply reflecting more robust supervised learning applied during post-processing? Existing experiments demonstrate that DAPS, as a complete system, works. However, authors have not yet sufficiently proven that dependency-aware set modeling is the primary reason why DAPS works.
3 comments
Responses to Reviewer yahQ (2/2)
Q2: “Second, are the experimental gains sufficient to validate the dependency-aware mechanism, as opposed to simply reflecting more robust supervised learning applied during post-processing? Existing experiments demonstrate that DAPS, as a complete system, works. However, authors have not yet sufficiently proven that dependency-aware set modeling is the primary reason why DAPS works.”
A3: Thanks for separating the system from the mechanism. We measured the mechanism directly. The table below gives the gain tied to each case's own set, the headroom with an oracle set, and the residual dependence in the data.
| MIMIC-III | MIMIC-IV | TCM-Onsite | TCM-Internet | |
|---|---|---|---|---|
| Set-specific gain (shuffled-set control) | +0.14 | +0.09 | +0.43 | +0.37 |
| Oracle headroom (recorded set as context) | +0.89 | +1.63 | +13.36 | +20.60 |
| Candidate pairs with residual correlation above 0.2 after Step 1 | 0.06% | 0.13% | 2.71% | 1.74% |
The mechanism's gain follows the conditional dependence in the data. It is clear on TCM and small on the EHR corpora, with supervised refinement as the larger source overall. On MIMIC the inputs (diagnoses, procedures, previous medications) already explain most co-prescription, so even an oracle provisional set would add only 0.9 to 1.6 points. On TCM the structure exists (oracle headroom of 13 to 21 points) and DAPS already captures part of it, which marks where further gains lie. Across the eight pairs the set-specific gain is +0.04 to +0.14 on MIMIC and +0.37 to +0.58 on TCM.
We appreciate these questions and welcome any follow-up during the discussion.
Follow-up to Reviewer yahQ
Dear Reviewer yahQ,
Thank you for your valuable feedback on our submission. With the rebuttal period nearing its end, we would be grateful to know whether our responses have addressed your concerns, and whether there is anything further we can clarify. We truly value your assessment and look forward to hearing from you.
Best regards,
The Authors
Responses to Reviewer yahQ (1/2)
We appreciate the time the reviewer spent on our paper and the thoughtful questions raised. We address each of them in turn below.
W: “The paper has not fully demonstrated that the observed performance gains stem primarily from the highlighted ‘dependency-aware set decoding’, rather than from other factors such as a more robust probability calibrator, additional supervisory models, or the optimization of the number of prescribed items. All backbones are augmented with an additional, separately trained prediction refinement pipeline; therefore, authors must also address the following question: Do these performance gains stem from the dependencies, or from the re-learning and calibration of the original model’s predictions?”
A1: Thank you for stating this so directly. Both: re-learning and calibration are the larger source overall, and set dependence is a measured additional source on TCM. We decomposed the gain on eight backbone-dataset pairs (two backbones per corpus), adding components in order, so each factor you name has its own row (values are changes in Jaccard points):
EHR: calibration and the expert bank explain almost all of the +5.06. Dependence on the case's own set adds +0.08.
TCM: the set-conditioned Step 2 is the largest component (+2.18 of +4.72). Of this, +0.45 is tied to the case's own provisional set, measured by the shuffled-set control (each case receives another case's provisional set; models, capacity and training unchanged).
Q1: “First, is the methodological innovation primarily a matter of complex system integration, or does it represent a truly unique and irreplaceable new decoding principle?”
A2: Thank you for this question. Both, in measurable parts. The table below separates what a simple decoding rule achieves from what the full post-hoc stage achieves.
No simple decoding rule reaches DAPS (36/36 pairs, mean +5.25). The post-hoc stage is therefore not replaceable by a rule.
The principle: the size should be chosen under the metric. Proposition 1(ii) shows that equal marginals do not determine the Jaccard-optimal set; empirically a tuned threshold on the same refined scores comes within 0.02 to 0.38 of our sizing rule.
What no rule replaces is the cross-fitted refinement. The expert bank and the set-completion networks are substitutes, and removing both loses 3.20 of the 4.89 mean gain.