- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Authors explore same-event counterfactual inference for transitions. The authors point out that matching action-conditional distributions does not determine same-event pairings, especially when action coverage is uneven.
CACTI models the state increment a combination of two terms (stage and event terms).
Results: CACTI has the lowest mean counterfactual error on experiments.
Critical strengths
- Clear problem framing and several experiments.
- The error decomposition is interpretable, and the paper also raises some of its limitations.
- Consistent gains across four environments of different type, including a high-dimensional one, and the assumptions are stated explicitly.
Critical weaknesses
- CACTI beats the baseline - but it is unclear where the gains are coming from.
- Only one high-dimensional task is evaluated, and there is limited discussion on the topic.
- Offline RL needs multi-step counterfactual trajectories, where one-step errors compound and the exogenous variables of later steps depend on earlier ones. The paper does not analyze or test how the error bound or the method scales to multiple steps, and the conclusion leaves it as a limitation.
Questions for authors
- Can you explain in plain English wha tis the Theorem 1 guarantes and novelty over previous works?
- Considering most offline RL needs multiple steps: did you test in this setting? What would be the challenges and limitations on extending to such a setting?
- On the high-dimensional tasks - what are the challenges?