- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes EAPO, an entropy-driven policy optimization method that adaptively adjusts positive sample weights based on the ratio of current to initial policy entropy. The method aims to balance exploration and training stability in open-ended QA. Experiments on two medical QA datasets show competitive performance and reduced sensitivity to initial weight settings compared with fixed-weight baselines.
Critical strengths
Simple and intuitive design. EAPO provides a straightforward and easy-to-understand mechanism for adjusting positive sample weights based on policy entropy, making it easy to implement and interpret.
Critical weaknesses
-
Limited novelty and missing baselines. Asymmetric weighting of positive and negative advantages is not new. The proposed entropy-based adjustment is relatively simple, and comparisons with relevant methods such as SAPO are missing, making its novelty and effectiveness unclear.
-
Insufficient motivation for medical QA. The paper does not clearly explain why open-ended medical QA requires a specialized approach or how it differs from other domains. The lack of cross-domain evaluation further limits the generalizability of the findings.
Questions for authors
-
Novelty: How does EAPO fundamentally differ from existing methods such as SAPO that already consider asymmetric weighting of positive and negative advantages?
-
Baseline comparison:Could the authors provide comparisons with stronger adaptive policy optimization methods, particularly SAPO, to better demonstrate the effectiveness of EAPO?
-
Medical QA motivation:What makes open-ended medical QA particularly suitable for EAPO? Are there any domain-specific challenges that motivate this design, and does the method generalize to other open-ended tasks?