- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RiskMaze, an automated safety evaluation framework for tool-based LLM agents. It constructs risk-relevant tool graphs to explore diverse risk paths, generates executable test cases, and iteratively refines them using execution feedback. The framework evaluates safety violations based on observed tool-use trajectories and environment states.
Critical strengths
-
The paper addresses an important problem in agent safety evaluation, particularly the need to assess risks arising from tool interactions and environment state changes rather than solely from final responses.
-
The proposed framework provides a relatively complete automated testing pipeline, covering test generation, execution-guided refinement, and risk verification.
Critical weaknesses
-
Unclear research problem and limited methodological novelty. The paper's central motivation is to improve risk-path coverage, but it is unclear what fundamental research challenge the proposed framework addresses beyond generating diverse safety test cases. The overall method appears to be a combination of relatively standard techniques, including LLM-based tool analysis, graph-based path enumeration, test generation, and execution-guided refinement. Moreover, the risk-path search is limited to a maximum of three tool calls, raising questions about its applicability to complex, long-horizon agent workflows.
-
Relatively outdated experimental setting and limited validation on modern agents. The experiments primarily rely on GPT-4o and GLM-9B as testing backbones, with additional analyses involving even older models. Although newer models are included as evaluation targets, the paper does not sufficiently investigate whether the proposed framework remains beneficial with stronger, more recent testing backbones. More importantly, the evaluation is based on 349 predefined task scenarios and simulated tool environments, leaving its effectiveness in realistic, complex agent settings unclear.
Questions for authors
N/A