acceptodds
Under review as a conference paper at ICLR 2027

Token-wise Reward Guided Reasoning Along Diagnostic Criteria for Depression Detection

Abstract

Large Language Models (LLMs) offer broad-coverage early screening while providing natural-language descriptions of mental health risks. Fine-tuning on medical annotations is costly and risks eroding their general capabilities. Inference-time alignment offers a flexible alternative, steering frozen LLMs toward desired preferences through reward models and thereby injecting medical knowledge into depression analysis without fine-tuning the LLM. However, existing methods spread the reward signal uniformly across all tokens, diluting supervision on the few tokens that bear decisive diagnostic evidence. To address this, we propose the AlignDx framework, which recasts depression detection as a Reason-then-Assess task in which the model reasons along diagnostic dimensions grounded in established medical criteria, and a downstream classifier derives the final risk prediction from this structured analysis. During reward model training, gradient-based importance estimation quantifies each token's contribution and reweights the autoregressive reward objective accordingly, concentrating the optimization signal on decisive tokens; at inference, reward-guided decoding via logit-space fusion injects diagnostic criteria into generation. Experiments on three datasets show that AlignDx outperforms both traditional classifiers and prior LLM-based approaches in in-distribution and cross-platform settings, with gains driven by stronger high-risk detection. Our code and datasets are available at https://anonymous.4open.science/r/AlignDx-3158.

Primary area:
applications to neuroscience & cognitive science
Keywords:
Depression Detection, Social Media, Large Language Model, Inference-time Alignment

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_p3fSOpenReview ↗
Rating
3
Confidence
3
Informativeness
3
Presentation
3
Soundness
2
Read review
Paper summary

The authors proposed a Reason-then-Assess framework for depression risk detection, in which the model first generates a structured multi-dimensional analysis and a downstream classifier performs the final risk detection. For the first step, the authors proposed a token-wise reward modeling approach and used it at inference time to guide and improve the model reasoning.

Critical strengths

The approach successfully improves inference-time alignment across datasets and backbone model families, compared to existing approaches including GenARM, SFT, and DPO. The ablations further provide evidence supporting the token-wise reward modeling. The Reason-then-Assess framework also provides valuable methodological insights for LLM-based mental health analysis.

Critical weaknesses

The token importance is estimated based on the final-position max logit, which measures tokens' influence on the model's prediction, but not their clinical relevance. It remains unclear whether important tokens indicate clinically meaningful evidence, and whether they reflect real risk signals of depression. Moreover, the clinical validity of both the generated reports and the final risk labels is unclear, since the labels in the datasets were not clinical diagnoses.

Questions for authors

Can the authors provide analysis or evidence supporting the clinical meaning of the token importance? Can the authors justify the clinical validity of the LLM-generated risk prediction and reports?

2 comments

Thanks for the positive assessment and for raising the important question of clinical validity. We want to be precise about what our current evidence supports. Below we clarify what the token weights measure, explain why decision-relevant tokens can still carry clinical meaning, discuss the validity of the labels and generated reports, and list the revisions we will make.

1. What ωt\omega_t measures and what it does not.

We agree that ωt\omega_t measures a token's influence on the prediction, not its clinical relevance. This is by design: the preference direction comes entirely from criteria-based preference pairs, and ωt\omega_t only acts as a positive scaling factor on each gradient term (App. B, Eq. 21–25). It can change how strongly a position is updated, but it cannot reverse the preference direction (see also Eq. 33). We therefore do not claim that gradient saliency equals clinical evidence. We claim that focusing a clinically defined preference signal on the most decision-relevant positions makes supervision more efficient. The w/o Weight ablation supports this: performance drops consistently on all three datasets, and the drops are larger on F1/MCC, which reflect high-risk detection (Table 2).

2. Why decision-relevant tokens can carry clinical meaning

Explanations from models grounded in clinical symptom frameworks have been found to match expert-annotated evidence more closely than those of models trained on diagnostic labels alone [1]. In the suicide-risk setting, attribution-derived evidence has likewise been shown to map onto clinically defined risk-factor categories, with these mappings validated against expert annotations and the resulting explanations rated helpful by practitioners [2, 3]. Across tasks and model architectures, gradient-based attribution has further emerged as the most reliable family of explanation methods in systematic comparisons [4]. AlignDx follows the same principle: weights are computed over reports organized by DSM-5/PHQ-9-grounded dimensions, so decision-relevant tokens sit inside clinically defined slots.

3. Validity of the labels and the generated reports

The dataset labels are not clinical diagnoses, and we do not claim that they are. Like most social-media mental-health benchmarks, our datasets rely on proxy labels. In eRisk, positive users are identified through self-reported diagnoses that were manually screened under strict rules [5]. WU3D and SWDD are built from user-level annotation protocols. Prior work notes that all such proxy signals have limited external validity [6]. This is why we use the term "risk detection," why the generation prompt states that "the label indicates depression risk rather than a clinical diagnosis" (App. D.1), and why the Ethics Statement excludes automated individual decision-making. Accordingly, we position AlignDx as a risk-screening framework, not a diagnostic tool.

The reports themselves, however, are anchored in clinical criteria: each dimension maps to DSM-5 criteria and validated instruments (PHQ-9, HAM-D), must cite verbatim quotes from the posts with fabrication explicitly prohibited, and is scored by the preference judge on grounding and accuracy (App. D.1–D.2). This design follows prior work showing that grounding model outputs in clinical symptom frameworks yields more meaningful explanations [1], and that social-media language contains clinically valid signal [7]. Supporting evidence appears in the case studies, where the aligned model correctly attributes speakers and context (Fig. 4, App. E), and the gains replicate across two downstream classifiers (App. H), indicating they stem from report content rather than any particular model.

4. Revisions.

We will make three revisions:

1.Change the wording in Appendix F.2 to "decision-relevant tokens, which in our examples coincide with symptom-bearing evidence."

2.Add the literature above to the Related Work section.

3.List expert validation of token weights as future work in the Limitations section.

We thank the reviewer again. These comments have helped us make our claims more precise, and we are happy to provide further clarification.

[1] Zirikly & Dredze, Explaining Models of Mental Health via Clinically Grounded Auxiliary Tasks, CLPsych 2022.

[2] Munz et al., Dual-Mode Explanations for Suicide Risk Detection in Online Mental Health Support, Information Systems Frontiers, 2026.

[3] Nguyen et al., Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data, 2023.

[4] Atanasova et al., A Diagnostic Study of Explainability Techniques for Text Classification, EMNLP 2020.

[5] Losada & Crestani, A Test Collection for Research on Depression and Language Use, CLEF 2016.

[6] Ernala et al., Methodological Gaps in Predicting Mental Health States from Social Media, CHI 2019.

[7] Eichstaedt et al., Facebook language predicts depression in medical records, PNAS 2018.

Thanks for your reply. Your clarifications do address some of my concerns.

Reviewer_X6RxOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This work introduces AlignDx, a Reason-then-Assess framework for social media depression detection. It shifts from brute end-to-end classification to generating a 7D structured clinical report before lightweight risk classification. Built on gradient-based token-level weighting and inference-time reward-guided decoding, the LLM evades emotion-word shortcuts without full fine-tuning and prioritizes clinical evidence. Cross-platform tests yield strong results, exceeding some large general models on select metrics. Ablations identify the downstream classifier as the main performance driver. Causal links between token weighting gains, gradient sensitivity and true clinical relevance remains to be rigorously validated.

Critical strengths

This topic is practically relevant. Addressing the key limitation that large models tend to capture superficial affective terms while missing latent symptoms and contextual cues in depression screening, this work enhances evidence identification via structured clinical analysis and token-level reward. The idea is promising, yet its merit lies largely in the research problem and fails to offset weaknesses in methodological novelty and experimental validation.

Critical weaknesses
  1. Methodological novelty is limited, with weak differentiation from prior work. Its Reason-then-Assess pipeline is close to DORIS (Lan et al., 2025); autoregressive reward modeling and inference guidance build on GenARM (Xu et al., 2025), while SePO (Yang et al., 2025) covers token-level weighting and preference optimization. AlignDx’s main contribution is gradient-based token weighting, yet the authors fail to show it outperforms existing token importance methods or verify its standalone gains via controls, leaving the necessity and novelty of this addition questionable.
  2. Validation of the core method is inadequate, casting doubt on experimental reliability. The authors equate generative models’ gradient sensitivity to clinical importance without expert annotations or counterfactual validation. All preference data relies on unvetted LLM judges, which risks uncalibrated clinical bias. Further, mismatches between accuracy metrics and sample sizes in Table 1, and inconsistent sample statistics against dataset scale in Figure 5, undermine the mechanistic interpretation and conclusions.
Questions for authors
  1. There is no human or expert evaluation to validate the LLM judge. If the judge misclassifies ordinary language as depressive symptoms, the subsequent reward model may amplify such biases. Since this work targets implicit symptom detection and overinterpretation mitigation, which require clinical judgment, expert validation is recommended.
  2. It remains unclear whether gradient sensitivity reflects clinical importance. Only token weight plots are provided, without direct validation. The gradient targets local sensitivity of generated text rather than validated clinical evidence weights. A counterfactual test is suggested: remove high-weight tokens and compare prediction shifts against low-weight and random token removal.
  3. The paper lacks sensitivity analysis for threshold τ. It aims to improve high-risk detection yet fixes τ at 0.5, so performance under different false-negative and false-positive costs remains unknown. Additional experiments are needed.
  4. Table 1 contains numerical inconsistencies: some accuracy values do not yield integer correct counts given the reported sample sizes. For Qwen GenARM, ACC, F1 and MCC on eRisk and WU3D match the w/o Classifier results in Table 2, while MDPD results diverge. The total 75993 samples for geographic diversity in Figure 5 also conflict with MDPD-10k’s 10000 samples. Please check whether statistical definitions and results have been misapplied.
  5. The main reported metrics are ACC, F1 and MCC. F1 gains can come from either precision or recall and do not guarantee better recall for high-risk cases. Given the distinct clinical costs of false negatives and false positives in mental health screening, separate precision and recall reporting is advised.
    1. The citation for Yang et al. (2025) is incorrect. Selective Preference Optimization via Token-Level Reward Function Estimation appears in EMNLP 2025 (pp. 7032–7056), not ACL 2025.
6 comments

Q1: There is no human or expert evaluation to validate the LLM judge. If the judge misclassifies ordinary language as depressive symptoms, the subsequent reward model may amplify such biases. Since this work targets implicit symptom detection and overinterpretation mitigation, which require clinical judgment, expert validation is recommended.

A1: Below we clarify the intended positioning of AlignDx and place our evaluation protocol in the context of current practice in this area. We then explain why, in our pipeline, judge errors are constrained rather than amplified.

1.Positioning. AlignDx is a research framework for risk screening and decision support. It is not a diagnostic system and is not intended for clinical deployment or automated individual decisions. It outputs a structured, evidence-cited report that serves as reference material for trained professionals. Every quote can be traced back to the original posts, and the final judgment rests with the human expert. This is consistent with our use of proxy labels, the term "risk detection", the generation prompt (App. D.1) and the Ethics Statement.

2.Evaluation practice in this research area. Our evaluation protocol follows the predominant practice in LLM-based depression and mental-health analysis on social media. Quantitative evaluation is based on dataset labels. Explanation quality is assessed with automatic metrics, LLM-based scoring and case studies, and clinician involvement, where present, is typically limited to designing prompts or templates or to inspecting small subsets [1, 2]. Systematically validating an LLM judge against clinicians is a substantial research effort in its own right. Recent work has had to build dedicated expert-annotated resources for this purpose.

3. Grounded judging. The judge scores each candidate block against the user's original posts, not the report alone. Its rubric (App. D.2) requires exact quotations and penalizes fabricated quotes, unsupported overstatement, and treating jokes, quoted text or generic venting as symptoms. The seven dimensions come from DSM-5, PHQ-9, HAM-D and related instruments (Table 5), not from an LLM.

4. Limited amplification. The reward model learns from relative preferences between two candidates for the same user and dimension. A bias shared by both candidates, such as reading negative wording as symptomatic, therefore largely cancels within a pair. ωt\omega_t only rescales updates and cannot introduce a new preference direction (Eq. 33). The final risk label is produced by a classifier trained on the datasets' human-annotated labels, not by the judge. If the judge systematically rewarded overinterpretation, this would show up as more false positives and lower Precision, a pattern we do not observe (Table 11).

5. Revisions. We will (i) add a Limitations paragraph noting that judge labels, especially on the Suicide Risk dimension, have not been validated by clinicians; (ii) soften the claim in Sec. 1 that criteria-based alignment "naturally counteracts the lexical shortcuts", rewording it as "constrains generation toward criteria-grounded, quote-verified evidence, which reduces reliance on lexical shortcuts".

[1] Yang et al., MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models, WWW 2024.

[2] Lan et al., Depression Detection on Social Media with Large Language Models, EMNLP 2025.

Q2: It remains unclear whether gradient sensitivity reflects clinical importance. Only token weight plots are provided, without direct validation. The gradient targets local sensitivity of generated text rather than validated clinical evidence weights. A counterfactual test is suggested: remove high-weight tokens and compare prediction shifts against low-weight and random token removal.

A2: Token-weight plots alone cannot reveal what the weights capture, so we ran the counterfactual test as suggested.

1. Scope of our claim. We do not claim that ωt\omega_t is a validated clinical evidence weight. ωt\omega_t measures a token's local influence on the model's prediction. The preference direction comes entirely from criteria-based preference pairs, and ωt\omega_t only acts as a positive scaling factor on each position's update (App. B, Eq. 21–25, 33). It can change how strongly a position is updated, but it cannot reverse the preference direction. The claim we can test is therefore that ωt\omega_t ranks tokens by decision relevance.

2.Counterfactual removal test. On the MDPD test set (Qwen3-4B-Instruct-2507), we computed ωt\omega_t for the AlignDx-generated reports following Eq. 6–8. We then removed the top-20%, the bottom-20%, or a random 20% of tokens (averaged over 8 seeds), and fed the modified reports to the same downstream Qwen3-0.6B classifier (τ = 0.5).

MethodACCPrecisionRecallF1MCC
Original0.90600.90070.81440.85530.7882
Remove high-ω\omega 20%0.85750.75420.86380.80530.6977
Remove random 20%0.86800.78480.84670.81460.7136
Remove low-ω\omega 20%0.87790.81500.83080.82280.7298

3.Findings. With the number of removed tokens held fixed, the degradation follows a consistent order on ACC, Precision, F1 and MCC. Low-ω\omega removal is the least harmful of the three, which indicates that ωt\omega_t also identifies tokens the decision depends on least. In all three conditions the drop comes mainly from Precision, with a small rise in Recall. This means that removing content makes the classifier more likely to predict the positive class, and the effect is strongest when high-ω\omega tokens are removed.

These results support ωt\omega_t as a measure of decision relevance. Together with the w/o Weight ablation (Table 2), they show that concentrating the criteria-based preference signal on these positions is beneficial.

Q3: The paper lacks sensitivity analysis for threshold τ\tau. It aims to improve high-risk detection yet fixes τ\tau at 0.5, so performance under different false-negative and false-positive costs remains unknown. Additional experiments are needed.

A3: We set τ=0.5\tau=0.5 as the classification threshold because it yields good and stable performance across our experiments. Following the suggestion, we have added a threshold sensitivity analysis in Appendix K. For each dataset (MDPD, WU3D, eRisk) and Qwen3-4B, we sweep τ\tau over [0, 1] and report the following curves:

(1)Precision and recall vs. τ\tau, which show how recall trades off against precision.

(2)ACC, F1, and MCC vs. τ\tau, which show whether the gains in Table 1 depend on the particular choice of τ=0.5\tau = 0.5.

(3)Normalized error cost vs. τ\tau, where the cost combines false negatives and false positives under different cost ratios, so a deployment that penalizes missed cases more heavily can choose a lower τ\tau.

The threshold sweep shows that all datasets lie on a broad, flat performance plateau around τ=0.5\tau=0.5, so the main-table results are not an artifact of the threshold choice, with only eRisk exhibiting a more pronounced recall drop at the high-threshold end.

Q4: Table 1 contains numerical inconsistencies: some accuracy values do not yield integer correct counts given the reported sample sizes. For Qwen GenARM, ACC, F1 and MCC on eRisk and WU3D match the w/o Classifier results in Table 2, while MDPD results diverge. The total 75993 samples for geographic diversity in Figure 5 also conflict with MDPD-10k’s 10000 samples. Please check whether statistical definitions and results have been misapplied.

A4: We responded to each item as follows.

(1) Accuracy values that do not yield integer counts.

The reported metrics are computed on valid samples only, not on the full test sets. For a very small fraction of users, the model could not produce a usable report: (i) the posting history exceeded the maximum context length, or (ii) the generated output did not follow the required structured format and could not be parsed. These users were excluded from the statistics. As a result, the denominator is smaller than the nominal test-set size, so the accuracies do not map to integers. We have added this clarification, and Appendix J now reports the valid sample size for every dataset and method.

(2) Qwen GenARM vs. "w/o Classifier" in Table 2.

The reviewer is correct. For Qwen GenARM on eRisk and WU3D, we mistakenly copied the values from the ablation ("w/o Classifier") in Table 2 instead of the GenARM baseline results. The corrected GenARM (Qwen3-4B) results are:

DatasetACCF1MCC
MDPD (unchanged)0.75490.72060.5627
eRisk (corrected)0.78880.44830.3954
WU3D (corrected)0.74820.71010.5781

These replace the previous eRisk entry (0.7899 / 0.4399 / 0.3815) and WU3D entry (0.7638 / 0.7221 / 0.5950). The change is small and does not alter any conclusion: AlignDx still clearly outperforms GenARM on all three datasets. We have rechecked every other row of Tables 1 and 2 against the raw prediction files to make sure there are no further copy errors, and we will update the best/second-best markings accordingly. Table 2 itself is unchanged.

(3) Sample count in Figure 5.

The inconsistency came from the unit of the geographic panel. The source dataset contains no user-level location information. The only location signal is the IP location attached to individual posts, and two factors prevent a user-level statistic: (1) Most posts carry no IP information. Of the 530,694 posts in MDPD (Table 4), only 75,993 (about 14.3%) have an IP location, and the geographic panel is computed over these posts only. (2) One user may post from several different IP locations, so there is no unique location to assign to each user.

The geographic panel is therefore a post-level distribution over the 75,993 IP-tagged posts, not a distribution over the 10,000 users. The follower-count and posts-per-user panels, by contrast, are user-level and consistent with Tables 3 and 4. We have revised: (1) relabel the geographic panel's axis title and caption as a post-level distribution over IP-tagged posts. (2) state in Appendix A.2 that most posts lack IP information and that a user may post from multiple locations, so user-level geography cannot be computed, and note that the panel describes only the IP-tagged subset and may not represent the full dataset. We have also rechecked all other counts against Tables 3 and 4.

Q5: The main reported metrics are ACC, F1 and MCC. F1 gains can come from either precision or recall and do not guarantee better recall for high-risk cases. Given the distinct clinical costs of false negatives and false positives in mental health screening, separate precision and recall reporting is advised.

A5: In Appendix L, we now report precision and recall separately for the normal class and the depressed class (Qwen3-4B, SFT, DPO, GenARM, AlignDx) on eRisk datasets.

MethodNormalDepression
PRF1PRF1
Qwen3-4B-Instruct-25070.95670.76700.85140.28240.72550.4066
–Best-of-N (N=5)0.95660.89400.92420.46000.69000.5520
–SFT0.96930.62700.76150.22220.84310.3517
–DPO0.96950.63070.76430.22400.84310.3539
–GenARM0.96380.79180.86940.31710.76470.4483
–AlignDx0.96470.90790.93540.51350.74510.6080

These results indicate that AlignDx improves depressed-class F1 primarily by increasing depressed-class precision without sacrificing recall relative to the base model, Best-of-N, and GenARM; in contrast, SFT and DPO achieve higher recall but suffer from much lower precision.

Reviewer_gc7ROpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The authors study depression detection on social media using LLMs, where the problem lies in models often taking lexical shortcuts by relying on explicit emotional words and their reasoning not being aligned with medical diagnostic criteria. They propose AlignDx, which makes the model write reports along seven diagnostic dimensions and then a classifier predicts the risk from the report. To steer the report, they train a reward model where each token is weighted by a gradient-based importance score, since existing methods spread the reward signal uniformly across all tokens, and at inference the reward model and base model are combined at every decoding step without fine-tuning the base model. The preference data for this is built by having two Qwen models generate reports and a third Qwen model judge each dimension separately. Their experiments on two Weibo datasets and one Reddit dataset show improvements over classifiers and LLM baselines, mostly in identifying the high-risk minority class.

Critical strengths
  1. The report and then classify pipeline is sensible and gives greater explainability on the decisions and easier for audits. The model has to write the report along the seven dimension with evidence and only then the risk is classified. Moreover, the case studies show useful behaviour, for example not treating first-person quotes from news headlines as the user’s own disclosures, and the authors are candid that this two-stage setup is not helpful on its own when the reasoning is not aligned.

  2. Building preferences per dimension rather than per report is a neat idea in my opinion. Instead of picking one whole report as better, they choose the better block for each dimension from either model and combine them, so a single preference pair can keep the strengths of both generators.

Critical weaknesses
  1. I felt most of the gain came from the trained classifier rather than the reward model, and the main comparison does not appear to be matched. In the ablation, removing the classifier causes by far the largest drop. The base model in the main table scores much lower than the base model with the classifier in the ablation, which suggests the SFT, DPO and GenARM baselines are not given the same classifier, even though the paper says they share the identical pipeline. Compared like for like, the reward model and weighting add only small gains, with no variance reported, and on WU3D the reward model with uniform weights actually does worse than no reward model.

  2. In general, the work relies on LLMs for almost every crucial step, which in my opinion is a concern for a sensitive task like mental health. The reports are generated by QWEN models, the preferences are decided by another QWENmodel acting as a judge, and the classifier is trained on these generated report, with no clinician or human annotator checking the evidence, the reasoning or the preference labels. I am not against using LLMs here, but some human grounding is needed, for example clinicians rating a subset of reports and preference pairs and reporting how well the judge agrees with them, especially for dimensions like suicide risk where errors matter most.

Questions for authors
  1. Was any human or clinician involved in checking the generated reports, the judge’s preference labels or the choice of the seven dimensions? If not, could the authors have clinicians rate a subset of reports and preference pairs and report how well the Qwen judge agrees with them, especially for the suicide risk dimension?

  2. Do the SFT, DPO and GenARM baselines in the main table use the same trained classifier as AlignDx, or do they predict the label directly from the report?

2 comments

Q1: Was any human or clinician involved in checking the generated reports, the judge’s preference labels or the choice of the seven dimensions? If not, could the authors have clinicians rate a subset of reports and preference pairs and report how well the Qwen judge agrees with them, especially for the suicide risk dimension?

A1: Thanks for the question. We agree that human grounding matters for a sensitive task like mental health, and we want to state clearly what human oversight was involved and what was not.

1. Choice of the seven dimensions. The dimensions were not proposed by an LLM. We derived them from published diagnostic criteria and instruments (DSM-5 criteria A1–A9, ICD-11, PHQ-9, HAM-D, WHODAS 2.0, Beck's cognitive theory, and psycholinguistic findings on absolutist language), and mapped each one to its source in Table 5. The authors reviewed this mapping and the scope of each dimension, and decided to keep Suicide Risk as a separate dimension because it has immediate safety implications.

2. Design of the generation and judging prompts. The report-generation prompt and the judge prompt (Appendix D) were written and iterated on by the authors. They encode constraints that target the failure modes we study: evidence must be an exact quotation from the user's posts, fabricated quotes and unsupported overstatement are penalized, implicit signals are rewarded only when supported by the full post history, and jokes, quotations and generic venting are rejected. The judge also sees the original posts and not only the report.

3.Manual inspection of generated reports. The authors read a subset of the generated reports and preference pairs across the three datasets to check format validity, whether quoted evidence was faithful to the posts, and whether the preferred block was sensibly better than the rejected one. The case studies in Appendix E come from this inspection.

We hope this gives an accurate picture of the human involvement in our pipeline and of its limits, and we thank the reviewer for pushing us to make these points explicit.

Q2: Do the SFT, DPO and GenARM baselines in the main table use the same trained classifier as AlignDx, or do they predict the label directly from the report?

A2: Thanks for catching this. In Table 1, the SFT, DPO and GenARM rows under "Reason-then-Assess" take the label from the LLM generates itself. They do not pass through the trained Qwen3-0.6B classifier. Our statement in Sec. 5.2 that these variants share the "identical pipeline" was imprecise. They share the report format and the generation prompt, but not the downstream classifier. We have revised the wording accordingly.

Why Table 1 was set up this way. Table 1 was intended as a system-level comparison, in which each method produces its prediction in its native way. For SFT, DPO and GenARM, the generated report already contains a label field, so we used it directly. For AlignDx, the downstream classifier is part of the method. We motivated it by the fact that LLMs produce poorly calibrated confidence, which threshold-based screening needs.

Why this is not enough. We acknowledge that this setting does not isolate the contribution of the reward model. The ablation in Table 2 already shows that the classifier is the largest single contributor. Part of the gap between AlignDx and the self-label baselines in Table 1 therefore reflects the classifier and not the alignment method. We will state this explicitly in the revised paper, and we will not attribute the whole gap to the reward model.

Matched comparison added in the appendix. To make the comparison like-for-like, we added a new appendix section (Appendix I) in which the same trained Qwen3-0.6B classifier (τ\tau = 0.5) is applied to the reports generated by SFT, DPO and GenARM on the eRisk dataset. Results with Qwen3-4B-Instruct-2507:

MethodACCF1MCC
SFT0.87220.57030.5176
DPO0.87440.56470.5086
GenARM0.88570.60080.5511
AlignDx0.88910.60800.5588

Under the same classifier, AlignDx still achieves the best ACC, F1 and MCC, so its advantage does not come only from the downstream classifier.

We thank the reviewer again for the constructive and detailed feedback. Both questions have helped us state the scope of human oversight more clearly and evaluate our method more rigorously, and we hope our responses address your concerns.

Reviewer_gc7ROpenReview ↗

Followup Response to Authors

I thank the authors for the clarifications and for adding the matched evaluation. It addresses the setup issue, but it also suggests that most of the gain comes from the classifier. Once all methods share the same classifier, AlignDx is only slightly ahead of GenARM. Since the token-wise weighting is what separates the two, this is the comparison that matters most for the paper’s main claim, and it is shown only on eRisk. The main text also still attributes the gains to alignment. On human grounding, I appreciate the clarification on how the dimensions were derived, but the judge’s labels have not been systematically validated by humans or clinicians. I would advise the authors to extend the matched comparison to MDPD and WU3D, which would strengthen the evidence for the token-wise weighting. I would however like to maintain my score in light of these points.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.