- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies answer-based co-training for LLM search agents through comparisons of parameter sharing, intermediate-answer training, process-reward placement, and feedback information. It evaluates several training variants on QA benchmarks and uses controlled answering and search diagnostics to examine their behavior.
Critical strengths
The paper considers a reasonably comprehensive set of co-training variants and conducts extensive ablations and diagnostic experiments. These comparisons help separate design choices that are often combined, particularly intermediate-answer training and process rewards.
Critical weaknesses
-
The paper lacks a clear central message and sufficiently deep analysis. The presentation feels fragmented, with many observations but limited explanation of what they collectively establish. Some findings are relatively expected, such as intermediate-answer training improving performance when the model is asked to answer early. Other results require more analysis: Full underperforms Aux-only on 2Wiki and Reasoning-masked on MuSiQue, but these differences are not adequately explained. Likewise, terminal aggregation performs well in the reported experiment, but the results provide limited guidance on when or why it should be preferred. Overall, the paper reads more like a preliminary collection of experimental observations than a focused study yielding substantial new understanding.
-
The evidence is insufficiently conclusive to support strong design recommendations. The macro-F1 differences between Full and Aux-only, and between Aux-only and Outcome-only, have 95% confidence intervals that include zero. Several diagnostic evaluations also use small question subsets, and each primary configuration has only one training run. These limitations leave uncertainty about the reliability and generality of the findings. The paper also lacks an explicit analysis separating single-hop and multi-hop QA; additional single-hop benchmarks such as TriviaQA and PopQA would help assess whether the conclusions depend on question type.
Questions for authors
-
Clarification: What explains the differing configuration rankings across datasets, particularly Full versus Aux-only on 2Wiki and Full versus Reasoning-masked on MuSiQue?
-
Clarification: Given that the process-reward sum telescopes to the final-state score minus the initial-state score, what substantive insight does the terminal-aggregation experiment provide beyond showing that this alternative reward placement works in the reported setting? What evidence supports a preference between the two placements?
-
Additional evidence: Do the main conclusions remain consistent with larger diagnostic samples and repeated training runs? An analysis separating single-hop and multi-hop questions would also help establish their scope.