- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces ORIGATE, a diagnostic framework for examining provenance invariance in learned action reviewers. The authors investigate whether models produce consistent representations and decisions for inputs that are equivalent under a predefined security policy. The framework identifies issues related to empty-slot handling and source partitioning, and uses fixed-parameter representation interventions to distinguish encoding inconsistencies from decision errors.
Through controlled experiments with matched training conditions and local action requests, the paper demonstrates that enforcing representation consistency can improve performance in some settings while introducing substantial errors in others.
Critical strengths
-
Clear problem formulation. The paper makes a useful distinction between representation invariance and policy correctness. I appreciate the authors' effort to identify different failure mechanisms rather than relying solely on aggregate prediction accuracy.
-
Careful experimental analysis. The matched-support experiments help isolate the effects of different provenance encodings while controlling for training contexts and labels. The analysis of corrected, introduced, and persistent errors provides additional insight into the consequences of representation interventions.
-
Transparent discussion of limitations. The authors acknowledge that enforcing representation consistency does not guarantee better predictions and provide examples where the proposed intervention negatively affects performance.
Critical weaknesses
-
Novelty and practical necessity. The framework combines established invariance properties, representation comparisons, and fixed-parameter interventions. While the analysis is useful, the methodological novelty remains somewhat unclear. Furthermore, given that the provenance information and security policy are explicitly defined, I would encourage the authors to clarify what ORIGATE offers beyond simpler approaches such as deterministic policy evaluation or canonicalized representations.
-
Context-dependent invariance and generalization. The framework evaluates provenance invariance under fixed policy facts and contexts. However, a transformation that preserves semantic equivalence in one context may become policy-relevant in another. Although the paper acknowledges this distinction, it remains unclear how well ORIGATE handles such context-dependent equivalence relations. I would encourage the authors to investigate whether the framework can reliably distinguish transformations that should remain invariant from those whose semantic implications change across contexts, particularly in more realistic agent environments.
Questions for authors
See weakness