- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates whether a state representation that is sufficient for a given task remains sufficient after the system takes actions based on that representation. The authors formalize this property as deployment closure and show that initially sufficient representations can become insufficient when deployment makes previously irrelevant hidden information consequential. They further analyze the information required to repair such representations and distinguish between repairing designated state pairs and the entire deployed interface. Experiments in the ABIDES market simulator demonstrate how hidden ownership information can affect post-deployment outcomes and how additional observations reduce decision loss. A separate learned world model experiment shows that relevant historical information may already be retained in recurrent states but remain underutilized by the transition predictor. Overall, the paper examines how deployment can expose limitations in state representations and how different information-related failures can be identified and repaired.
Critical strengths
The problem studied is new. Both theoretical and experimental results are provided.
Critical weaknesses
-
The paper should connect itself better with the literature and spend more effort on demonstrating the applicability. The connection between the theory and numerical results seems weak.
-
The theorems are all based on standard math techniques. For instance, Theorem 1 uses a simple construction. Proposition 2 reduces to a standard set cover formulation, and Lemma 3 follows from classical conditional expectation properties. Although the paper formalizes an interesting problem, it is unclear how much new theoretical insight these results provide beyond existing work on state abstraction and deployment induced distribution changes.
-
The paper introduces a cost aware formulation in Proposition 2, but this formulation is only weakly connected to the subsequent decision analysis.
Questions for authors
-
Can the connection between the theory and experiments be made more explicit or stronger?
-
Besides technical contributions, can the applicability of the proposed framework be better demonstrated, via for example, downstream decision analysis?