- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper studies the setting where the action selection is not necessarily the action actually executed. This then makes the problem one of hidden actions. Then then ask under which conditions such actions become identifiable and propose a modification of the DreamerV3 framework to address the problem. The authors provide both theoretical and empirical results.
Critical strengths
- The problem studied seems interesting and practically relevant.
- The paper is well motivated
Critical weaknesses
- The paper is not very well written and at times hard to follow. It follows a non-exhaustive list of things I have noticed:
- A lot of phrases are used once or twice and then never used again
- In the abstract is says: “We formalize this mismatch as an action-fidelity problem” but “action-fidelity problem” is not used again in the main part of the paper.
- Are “execution protocol”, “execution process” the same thing?
- About “control variable”: are these simply the actions actually performed? It appears twice and then is not used again.
- Are “hidden actions” and “latent actions” and “latent components” the same thing?
- Are “Bayes prediction gap” and “Oracle prediction gap” the same thing?
- “latent execution channel” is used once in contributions
- equations (6), (7), (8) are the same as the ones of (17), (18), (19)?
-
“The oracle gap in Theorem 1 does not imply that a hidden channel is recoverable.” Why would the reading think that Theorem 1 would imply that a hidden channel is recoverable?
-
Theorem 1 and Corollary 2 seem trivial and in particular do not establish "A useful surrogate must therefore preserve execution-relevant history not already contained in S".
-
The remaining theoretical results have while not trivial are quite basic and seem to have little novelty.
-
There is significant related work missing on hidden action identification (e.g. "Nikulin, A., Zisman, I., Tarasov, D., et al. (2025). Latent Action Learning Requires Supervision in the Presence of Distractors", "Schmidt, D., & Jiang, M. (2024). Learning to Act without Actions", "Schur, F. (2026). Identifying Latent Actions and Dynamics from Offline Data via Demonstrator Diversity"). Schur (2026) work seems especially related: If one views the intended action as a the demonstrator one might be able to apply (under additional assumptions) their results and get a meaningful theoretical result.
Questions for authors
- In what respect are the theoretical results novel/non-basic?
- How do these results relate to established works on identifying hidden actions?