- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the Semantic-Information Flow Gap (SIFG) in LLM agents: external information may continue to influence downstream actions after neural regeneration, even when its original provenance is no longer observable at the authorization interface. The authors separately measure Semantic Survival, Provenance Retention, and Counterfactual Action Dependence, and compare different provenance propagation and enforcement strategies. They further show that when malicious and benign executions produce identical gate-visible observations, authorization rules restricted to those observations cannot distinguish them. An additional action-semantic signal can expose this distinction in controlled experiments.
Critical strengths
-
SSR, PRR, and CAD separately assess content survival, provenance visibility, and action-argument dependence, avoiding the assumption that a surviving string necessarily influences an action. The CAD experiments include several counterfactual interventions and a Repeat control for decoding noise. Reusing the same cached regenerated artifact across propagation rules also reduces the influence of decoding randomness on the comparisons. (Pages 3–6)
-
The indistinguishability proposition is explicitly restricted to a fixed gate-visible observation, and the authors empirically check observational equivalence between paired executions. The appendix provides per-configuration counts, confidence intervals, and supplementary experiments. The host allowlist is also appropriately presented as a witness rather than a complete, deployable defense.
Critical weaknesses
-
The attribution of provenance loss to neural regeneration is not sufficiently separated from the choice of propagation policy. On page 4, symbolic transports explicitly preserve source identity, whereas PRR=0 for neural regeneration is obtained under the tested Producer Provenance interface. Page 6 further explains that PLP records only the current producer, while TSP records the upstream source. Therefore, the difference is at least partly attributable to different metadata recording and propagation policies. If an interface does not record ancestors by design, while PRR checks for those ancestors, PRR=0 alone does not establish a provenance-loss phenomenon specific to LLM regeneration. The authors’ own TSP experiments also demonstrate that provenance labels can be retained for LLM outputs. The paper should compare symbolic and neural transformations under consistent propagation policies, or explicitly narrow its conclusion to provenance omission under producer-local interfaces. It should also clarify whether PLP represents a real framework’s default behavior, an existing defense, or a researcher-defined policy.
-
Provenance loss and the inability of provenance to determine action legitimacy are not sufficiently distinguished, weakening the positioning of the core contribution. The definition of SIFG requires the original source provenance to become unobservable. Under TSP, however, provenance is retained. The remaining inability to distinguish malicious from benign executions arises because the same source can provide content with different authorization implications, not because provenance remains lost. Both phenomena are worth studying, but they are not the same mechanism. The latter can also arise in ordinary parameter-transfer pipelines without an LLM—for example, when an external document supplies two URLs, only one of which complies with the owner’s policy. Proposition 1 is correct, but the conclusion that identical decision inputs yield identical decisions or decision probabilities follows directly from the interface definition. Consequently, the paper’s novelty must primarily come from its empirical findings: what new mechanism does it establish beyond existing concerns about coarse-grained taint tracking, overtainting, or declassification? This remains insufficiently clear. (Pages 3 and 6–9)
Questions for authors
-
Which actual provenance trackers or security systems do PLP, TSP, and the other evaluated rules correspond to? Under identical instrumentation, do symbolic and neural transformations still exhibit different PRR values?
-
Could the authors provide a complete paired malicious and benign execution example, specifying the owner’s policy, the malicious source text, the intervention point, and the resulting unauthorized action?