- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors focus specifically on coordination scenarios, and find that on Qwen3-4B-Instruct-2507 (individual LLM) has errors through both preference inference and action selection/planning. Giving oracle judgement changes the model’s actions, but also doesn’t make planning necessarily better. The authors turn oracle-labeled game slices into training data for training with GRPO. The authors also extend on a multi-party negotiation game, CalBench, to include private preferences and investigation actions, evaluations show that supervised training from controlled game slices can transfer to games with other interaction mechanics.
Critical strengths
The authors break down a general problem (agents coordinate poorly) into two isolated clear branches: preference inference and action selection and extend a commitment-based negotiation game to involve private preferences and information gathering. The design to be able to isolate the two problems is nice through comparing planning with the judgement (based on preference judgement from history and available information) vs with an oracle judgement. The authors evaluate game slice games with various numbers of players and also extend to CalBench, with different game dynamics.
Critical weaknesses
The paper results rely on one single base model. It would be interesting for the first portion of the results (the evaluation of preference inference and action selection) on various models (both open sourced and closed sourced and of various sizes), and look at findings to see if perhaps there are interesting patterns or if models are generally better at one than the other (and perhaps more recent models are more capable at planning and inference than older models). The authors should also perform training on a few other models as well. Then this might also help with slightly alleviating burden on same vs different model negotiation (if the findings hold amongst multiple models after training, different models can be substituted in perhaps with not much effects to the results perhaps; or this could make it easier to examine more effects on multi model negotiation).
After slice training with GRPO, the trained model retains more meetings on CalBench, though it would also be interesting to see if the trained model also just performs better on the first experiments described comparison to the oracle evaluation of preference inference and planning, to see if there are improvements specifically to both or one that helps to better explain the improvement in performance on CalBench compared to other models. Also since the authors have isolated between the preference inference and planning, is there any difference when training with these in isolation? (if training on preference inference would increase performance of preference inference evaluations?)
There are some other relevant work that might be good to cite: works on similar theoretical formulations of multi-agent/agent+human collaboration: [1] Hadfield-Menell, D., Russell, S. J., Abbeel, P., & Dragan, A. (2016). Cooperative inverse reinforcement learning. Advances in neural information processing systems, 29.
[2] Büning, T. K., George, A. M., & Dimitrakakis, C. (2022, June). Interactive inverse reinforcement learning for cooperative games. In International Conference on Machine Learning (pp. 2393-2413). PMLR.
[3] Ma, R., Qu, J., Bobu, A., & Hadfield-Menell, D. (2025). Flexible Agent Alignment with Goal Inference from Open-Ended Dialog. arXiv preprint arXiv:2508.15119.
[4] Dai, A., He, Z., Zhang, Z., Pentland, A., & Pei, J. (2026). Interactive Task Alignment as a POMDP. arXiv preprint arXiv:2607.16412.
[5] Zhi-Xuan, T., Ying, L., Mansinghka, V., & Tenenbaum, J. B. (2024). Pragmatic instruction following and goal assistance via cooperative language-guided inverse planning. arXiv preprint arXiv:2402.17930.
Questions for authors
Interested to know more about the performances of other models as well for the first evaluation on preference inference and planning (are there any trends that have to do with scale or family model or capabilities with the more recent models). How well do the training results generalize to training for other models? How well do trained models perform on the first evaluation on preference inference and planning? Is there a way to isolate training for preference inference data vs planning data, and would that increase the performance of one or both accordingly? How well would this generalize to less constrained/less formated/templated multi-agent games?