- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates whether the domain synergy observed in multi-domain reinforcement learning with verifiable rewards (RLVR) reflects genuine interactions between domains and whether such synergy can further improve model training performance. The paper also examines the transferability of domain interactions across different evaluation distributions. It finds that interaction models can support domain combination selection reasonably well under the current experimental setting, while the optimal combination identified on the source evaluation suite may not reliably transfer to the test suite.
Critical strengths
-
The paper examines a relevant measurement issue in multi-domain RLVR. It highlights how training-budget allocation may influence domain interactions and capability improvements, and provides a mathematical analysis of this effect.
-
The paper includes several empirical analyses to support its observations. The authors consider different training-budget allocations, statistical correction methods, and evaluation settings. Although the experimental scale is relatively limited and the findings are not consistently reproduced across settings, these analyses provide some preliminary evidence for the identified measurement issue.
Critical weaknesses
1.The paper suffers from serious clarity and presentation issues. The manuscript contains numerous technical terms and expressions that are introduced without sufficient explanation and are not necessarily standard terminology in the field, such as "significant order-3 and order-4 interaction" and "D-optimal rule." Moreover, the research motivation and discussion of existing work are particularly difficult to follow. Overall, I find the manuscript insufficiently polished and closer to a preliminary draft than a publication ready paper.
- Several key claims lack sufficient empirical support. The experimental evidence does not adequately substantiate some of the paper's broader conclusions. First, the main findings are established primarily in a four domain setting using a small scale model, while the additional model and algorithm configuration fails to reproduce the same interaction patterns. Second, the curvature analysis does not directly evaluate the reward weighted Hessian quantities underlying the theoretical formulation. As a result, the experiments do not directly validate the theoretical analysis, leaving a substantial gap between the theoretical arguments and empirical evidence.
Questions for authors
See the weakness