- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
The paper is concerned with LLM tutoring, where an LLM is trained for tutoring via an RL loop with a student simulated by another LLM. While prior work has kept this student simulator fixed, this work trains both the tutor and student together and does not keep it fixed. The authors show favorable results in the evaluation.
Critical strengths
- To me the overall promise makes a lot of sense and, on a methodological level, the execution also seems sound as described in Alg. 1. The results are also favorable, though there are concerns that I outline below.
Critical weaknesses
-
My main concern is about the evaluation. This concern might also stem partially from not being able to clearly understand the set-up despite thorough reading. The way I understand 5.1 is that all baselines are evaluated against a frozen student simulator while the presented method is compared against the jointly-trained student (cf. the writing in L326-330). This would mean that these numbers are not comparable; a more proper evaluation would be to use a held-out set of students that is the same for each method. Similarly, it is unclear how to relate 5.2 to 5.1 and which model was used for evaluation in 5.3: was it again the respective jointly-trained student? If so, these numbers are again not directly comparable and it is unclear if the student training actually helps. This to me is a critical flaw that needs to be addressed before this work can be accepted. If it is due to my misunderstanding, I would like to ask the authors to clarify it both to me and in the writing. Overall, it would help to describe the method and experiments more clearly.
-
A less significant concern is that the paper largely shares the methodology with Dinucu-Jianu et al. 2025, for example, in terms of rewarding the expected solution rate but does not properly attribute this. A comparison seems missing to me but might be contained in 5.3, though this needs clarification as written above.
Questions for authors
-
Please address my concerns above about the evaluation protocol, these are critical for my assessment.
-
Could you please justify how the utility in L236 models ZPD? Did you try other functions, how did they perform?
Suggestions for future versions:
-
Fig. 2 is quite hard to understand, it seems more like a collection of approaches than one unified approach. It would greatly improve the figure to show the flow of information through it and how, for example, specific rollouts are treated.
-
The notation could be improved, for example, in the factorization at the beginning of Sec. 4.1 it is not immediately clear that is contained in . Perhaps, could be used for history throughout?
-
It would be helpful to put a forward reference for and next to their respective definitions in Eq. 2 and Eq. 3.
-
In Sec. 4.1 the joint distribution is exchangeable (it seems?) refered to as and which should be unified
2 comments
Thank you for your response and for clarifying the evaluation set-up. That alleviates my concern that the student model used in evaluation is different, it will be good to write this very clearly in the paper. I will raise my score accordingly.
Thank you once again for your constructive feedback and assessment! As the discussion phase is drawing to a close, we are reaching out to follow up and see whether our responses and additional experiments have adequately addressed your concerns. Should you have any further questions, we would be very happy to provide additional clarification, and we look forward to your further consideration.