- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper aims to address the problem of "shortcut refusal", where the LLMs might wrongly refuse a request just based on the superficial feature of the request (e.g., decision is based on just certain topic words). To this end, the paper provides TRACE, a set of matched prompts that differ in one safety condition, and measure the refusal decision before answer generation. Using the two defined metrics, Route Faithfulness (RF) and Attribution Gap (AG), we can identify the decision safety evidence from the input. Finally, the authors propose CICA-TRACE, a method that aligns refusal decisions with decisive safety evidence.
Critical strengths
- The focused problem is well-motivated.
- The authors provide a dataset that can be beneficiary to the community.
Critical weaknesses
- Not sure whether the counterfactual sample generated by the method is reliable, or there are also other errors introduced. It also remains unknown how do the authors ensure the edited statements represent meaningful changes rather than some artificial errors.
- When constructing TRACE, only individual evidence intervention is applied. However, real-world safety decisions oftend depend on the interactions among multiple evidence.
Questions for authors
- How are the counterfactual intent and policy edits constructed and validated? Any human annotators involved? This is pretty important for evaluuating the quality of the constructed models.