- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how structured decision-making workflows from Clinical Practice Guidelines (CPGs) can provide process-level supervision for clinical reasoning in large language models (LLMs). The authors identify two key challenges: Path Multiplicity, where multiple valid reasoning paths may support the same clinical decision, and the Path–Answer Gap, where guideline-consistent reasoning does not necessarily lead to a correct answer. To address these issues, they propose GUIDER, a framework that jointly optimizes a Controller and a Policy. The Controller learns reference decision paths through supervised learning and generates multiple candidate paths for each case. These paths are weighted by their coverage of the reference path, and token-level Jaccard similarity is used to construct a Multi-Flow Process Reward. An Answer-Gated Reward further ensures that additional process rewards are granted only when the final answer is correct. Both components share model parameters and are jointly optimized using supervised learning and GRPO.
Experiments on MedGUIDE, AMEGA-LLM, RealMedQA, and CancerGUIDE, using Qwen3-14B and Gemma4-12B, demonstrate that GUIDER outperforms existing clinical reasoning reinforcement learning methods, including CRPO, MRPO, and FaithMed. On Qwen3-14B, GUIDER achieves 82.5 Weighted Accuracy and 73.5 Guideline Adherence on MedGUIDE. Overall, the paper addresses a practically important problem with a reasonably novel approach and promising empirical results. However, it remains unclear whether the proposed method truly resolves Path Multiplicity and how much the multi-path process reward improves performance compared with simpler reference-path supervision. More thorough theoretical analysis and experimental validation are needed to substantiate these claims.
Critical strengths
- This paper focuses on the correctness of the clinical reasoning process rather than solely on final answer accuracy. This distinction is particularly important in healthcare, where a model may arrive at the correct answer through incomplete reasoning or reasoning that does not align with clinical guidelines. The authors further identify two key challenges, Path Multiplicity and the Path–Answer Gap, providing a clear problem formulation for guideline-based process supervision.
- The paper integrates guideline-derived decision path supervision with reinforcement learning. Specifically, the Controller generates candidate decision paths, which are then used to construct process rewards for the Policy. Unlike approaches that require retrieving or executing clinical guidelines during inference, GUIDER incorporates guideline supervision only during training, eliminating the need for an additional Controller or guideline access at inference time. This design offers potential advantages in deployment efficiency.
- GUIDER achieves improvements on both Qwen3-14B and Gemma4-12B and outperforms the compared reinforcement learning baselines across multiple clinical reasoning benchmarks. Notably, on MedGUIDE, GUIDER improves both answer accuracy and guideline adherence, whereas direct Answer + Flow SFT improves guideline adherence but substantially reduces answer accuracy. These findings suggest that jointly optimizing answer correctness and process-level supervision is a promising direction for further research.
Critical weaknesses
The central motivation behind Path Multiplicity is that multiple clinically valid, guideline-consistent decision paths may exist for the same case, and therefore, a single reference path should not serve as the sole supervision target.
However, in the proposed method, each Controller-generated candidate path is still scored based on its coverage of the single annotated reference path :
These scores are then used to compute candidate path weights, which are combined with the Jaccard similarity between the Policy-generated path and each candidate path to construct the final process reward:
This means that even if a candidate path is clinically valid, it may receive a low reference-path support score simply because it shares relatively few nodes with the annotated reference path, thereby reducing its contribution to the final reward.
Although incorporating multiple candidate paths can partially alleviate the limitations of single-path matching, the current design does not guarantee that structurally different but equally clinically valid reasoning paths will be appropriately rewarded.
The paper uses token-set Jaccard similarity to measure the consistency between Policy-generated paths and Controller-generated candidate paths. Although this metric is simple to implement and computationally efficient, it remains unclear whether it can effectively capture the correctness of clinical decision-making processes.
Questions for authors
See the weaknesses.
3 comments
[2/2]:
W2: We thank the reviewer for highlighting these concerns. We agree that token-set Jaccard similarity is a lightweight approximation of clinical reasoning compatibility and does not explicitly capture negation, medical synonyms, or temporal dependencies. However, GUIDER's process reward combines reference-node coverage with weighted agreement across multiple controller-generated trajectories, rather than relying on a single Jaccard comparison. To investigate these limitations, we conduct additional experiments examining the sensitivity of GUIDER's process reward to clinically incorrect trajectories and its ability to accommodate valid alternative decision flows.
Error discrimination analysis
MedGUIDE contains structured clinical decision flows derived from 55 NCCN decision trees spanning 17 cancer types. We select 200 test cases and introduce three types of corruption:
- Unsupported-node injection: Add a clinical recommendation not supported by the applicable guideline.
- Contradicted-action injection: Introduce an action conflicting with the patient's clinical conditions.
- Condition–action swap: Associate an action with an incorrect clinical condition while preserving the original clinical concepts.
We measure Error Discrimination Rate (EDR), the percentage of cases where the clean trajectory receives a strictly higher reward than its corrupted counterpart. Both are evaluated using identical controller proposals and weights, without retraining. We additionally replace GUIDER's token-set Jaccard similarity with a frozen Qwen3.5-4B judge that scores semantic compatibility, keeping the remaining reward components unchanged.
| Corruption type | Coverage-only EDR (%) ↑ | GUIDER (Jaccard) EDR (%) ↑ | GUIDER (LLM judge) EDR (%) ↑ |
|---|---|---|---|
| Unsupported node | 0.0 | 84.5 | 85.3 |
| Contradicted action | 0.0 | 89.0 | 91.3 |
| Condition–action swap | 0.0 | 12.5 | 58.5 |
Reference coverage cannot distinguish these errors because the original reference nodes remain present. GUIDER with Jaccard discriminates unsupported nodes (84.5%) and contradictory actions (89.0%) but struggles with condition–action swaps (12.5%). Jaccard-based GUIDER effectively detects unsupported recommendations (84.5%) and contradictory actions (89.0%) but exhibits limited sensitivity to condition--action swaps (12.5%). The LLM judge improves discrimination across all corruption types, with the largest gain for condition--action swaps (58.5%), highlighting the benefit of semantic compatibility scoring for capturing clinical dependencies.
Computational efficiency
We compare training time under identical data, architecture, and optimization settings, varying only the similarity function.
| Similarity function | Training time (hours) ↓ |
|---|---|
| Jaccard | 10 |
| Qwen3.5-4B judge | 25 |
The LLM judge requires 2.5× longer training time (25 vs. 10 hours). Thus, Jaccard offers a more computationally efficient alternative, although it is less sensitive to complex clinical dependencies.
Dear Reviewer 5sVS,
As the discussion deadline is approaching, we would like to kindly follow up on our rebuttal and the additional experiments addressing your concerns regarding path multiplicity, alternative-flow coverage, and the effectiveness and limitations of Jaccard-based process rewards.
We appreciate your positive assessment of our work and your constructive suggestions, which have helped us strengthen the empirical analysis and refine our claims.
We hope our responses have addressed your concerns and would greatly appreciate your feedback. We would be happy to provide any further clarifications before the discussion period concludes.
Thank you again for your time and consideration.
[1/2]:
W1: We thank the reviewer for this suggestion. We agree that demonstrating clinically valid alternative paths, rather than merely stochastic paraphrases, is important for validating the path-multiplicity motivation. To address this concern, we conduct two additional evaluations.
Alternative-flow recognition:
MedGUIDE is constructed from 55 NCCN clinical decision trees spanning 17 cancer types. The dataset creators convert these trees into structured JSON, enumerate and manually review root-to-leaf decision paths, and generate patient scenarios conditioned on these paths. Each question therefore has an underlying guideline-derived reference trajectory.
We select 200 MedGUIDE test cases and use their corresponding guideline trees to construct four trajectories: (i) the reference path (zA), (ii) a valid reordering of independent decisions (zB), (iii) a structurally distinct, guideline-consistent alternative applicable to the same patient (zC), and (iv) an invalid condition–action flow (zD). We construct alternative clinical flows by identifying cases that share a common decision path of more than two nodes and using the shared subpath as a clinically plausible alternative. While imperfect, this provides a practical approximation without requiring additional clinical expert annotation. We follow the same approach for (zC), constructing an alternative flow from a shared subpath within the guideline decision tree. Its clinical validity is assumed following the NCCN decision tree structure.
We compare GUIDER against single-reference matching, Rsingle(z)=J(z,zA).
GUIDER assigns higher reward to the distinct valid alternative than single-reference matching (0.72 vs. 0.43). The invalid flow receives substantially lower reward (0.25). These results suggest that multi-flow aggregation better accommodates valid alternative reasoning paths, although reference-dependent weighting may still penalize alternatives with limited lexical overlap.
2. Coverage of clinically valid alternative paths
We further evaluate whether increasing the number of controller samples improves the coverage of structurally distinct, clinically valid alternatives on the 200 test samples. We introduce ValidAltCoverage@M, defined as the percentage of cases containing at least one clinically valid controller proposal that is structurally distinct from the annotated reference.
Increasing M from 1 to 4 improves ValidAltCoverage from 18.4% to 41.8%, alongside improvements in weighted accuracy and guideline adherence. This provides evidence that additional controller samples increase the likelihood of identifying clinically valid alternatives rather than simply reproducing the reference trajectory. Together, these experiments demonstrate that GUIDER can assign meaningful process credit to distinct valid alternatives and that multi-flow sampling improves their coverage. We acknowledge that reference-anchored scoring may still underreward valid paths with limited lexical overlap, and that the current reward does not formally guarantee clinical validity. Nevertheless, these evaluations provide direct empirical support for the benefits of multi-flow supervision beyond stochastic paraphrasing.