- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Cond-Opt, a data selection method based on nuisance-adjusted Fisher information, to improve the detection of structured interaction effects in preference data. Experiments demonstrate improved detection power over baseline methods.
Critical strengths
1, The paper addresses a meaningful problem by focusing on preference data selection for detecting structured interaction effects, rather than solely improving reward-model fitting.
2, The paper includes theoretical analysis and extensive experiments across different labeling budgets, noise levels, and data settings.
Critical weaknesses
1, The paper is generally well-written and follows a clear overall structure. However, the connections between some theoretical analyses and the proposed method could be better explained, see questions below.
2, The authors should better clarify the purpose of each experiment and the connections between them to strengthen the overall narrative and highlight the paper's main contributions.
3, The paper offers an interesting application of classical statistical principles to preference data selection. However, the core methodology largely builds on established Fisher information and optimal experimental design techniques, which limits the novelty of the contribution.
Questions for authors
1, In line 55, the authors use without first defining or explaining it.
2, The interaction between verbosity and correctness used to motivate the problem in the Introduction differs from the aggregate conflict feature (line158) studied in the paper. The authors should better explain the motivation for choosing this particular interaction feature.
3, The main improvements in detection power are demonstrated using simulated preference labels generated from the logistic model assumed by the proposed method. It would be valuable to evaluate the robustness of Cond-Opt under model misspecification, particularly when the true preference-generating process differs from the assumed logistic interaction model.