- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a 30-task benchmark to measure instruction following under an increasing number of required tool calls. Results show that models can perform tasks requiring less than two chained tool calls, with significant performance differences for more complex tasks.
Critical strengths
None
Critical weaknesses
- The tasks or trajectories are not released or described in enough detail to assess the work.
- The benchmark consists only of 30 tasks.
Questions for authors
- Could authors release the tasks and trajectories?