- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Multimodal Access Control (M2AC), which assigns access control decision for cross-modal data in multimodal RAG systems. The proposed M2AC framework consists of two parts, Derived Permission Propagation Engine (DPPE) and Modality-Aware Policy Enforcer (MAPE). DDPE uses information retention ratio ρ and attenuation rule to measure the permission of nodes under different operations. MAPE assigns allow/degrade/deny permission for requests according to the DDPE rule. Empirical evaluations show that the proposed method produces the fewest rules at comparable generation time and has a high defense success rate against four types of cross-modal attacks.
Critical strengths
This paper proposes a complete modality-aware policy enforcement mechanism covering the entire process from retrieval to generation for multimodal RAG systems. It gives a new idea of how to achieve permission control for objects under operations (e.g., OCR, caption, summary, embed, crop,and translate) used in multimodal RAG systems. This is an interesting and timely contribution to the system access control area.
Critical weaknesses
There is no theoretical guarantee for the selection of each retention ratio ρ and threshold τ. They are selected empirically. The empirical evaluations show that the defense success rate does not reach 100% for all attacks. Therefore, the confidential objects in the system are not guaranteed to be secure and are at risk of leaking. I don't think this is acceptable for high-security systems.
Questions for authors
(1) Could the authors explain why the permission can be degraded after these mentioned operations? What is the advantage of this design? Does the advantage overweigh the additionally introduced risk of information leakage?
(2) Could the authors provide a detailed system scenario that M2AC can apply to? What is the security level of this system? Is the average defense success rate of 96.2% acceptable to this system?
(3) Since the threat model assumes an active attacker/insider holding low-privilege credentials. What is the defense success rate when the attacker combines all attack methods and use more adaptive attacks (e.g., reverse-engineer permission boundaries)? Although this is discussed as a limitation, it is very important to conduct such analysis for security concerns.