- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
CausGround extracts action preconditions and effects from interaction data and uses the resulting rules to guide a frozen multimodal planner. The paper reports improvements across several embodied benchmarks.
Critical strengths
The problem is relevant, the evaluation spans multiple settings, and the retrieval and rule-component ablations are useful.
Critical weaknesses
- The incremental contribution is unclear. Learning action preconditions and effects for planning has a long history, while InterPreT and PSALM-V address closely related embodied settings. The paper does not adequately distinguish its mechanism from these works or compare against a learned action-model planning baseline.
- The “causal” claim needs qualification. Appendix C.3.1 uses controlled factor variation in VirtualHome, but extracts rules from observational consistency in RoboCasa and SWITCH. The latter does not by itself establish that a retained factor is a causal prerequisite.
- The method requires an environment-specific rule library built from substantial interaction data. The paper should report this construction cost and test whether its gains persist under a matched data and computation budget.
Questions for authors
What improvement remains over a standard learned action-model planner given the same observations and interaction data? How are correlated but non-causal conditions excluded in RoboCasa and SWITCH?
5 comments
W3 & Q1: Knowledge Construction Cost and Learned Action-Model Comparison
We appreciate the reviewer's emphasis on construction cost and fair comparisons. To quantify the data requirements of CausGround, we evaluated different interaction-data budgets in VirtualHome and report the corresponding knowledge coverage and generation costs below. Notably, with only 10% of the interaction data, CausGround already achieves the full-data 44.00% success rate. Additional data further broadens knowledge coverage across different action families and object instances. Importantly, as described in Section 3.3, CausGround requires no planner parameter updates, avoiding gradient-based optimization.
| Data Ratio | Programs | Records | Action Coverage | Generic Sets | Specific Candidates | Success Rate (%) | Generation Time |
|---|---|---|---|---|---|---|---|
| 1% | 15 | 700 | 26/40 | 10 | 6 | 34.67 | 15 min |
| 5% | 75 | 3,206 | 37/40 | 17 | 12 | 41.33 | 70 min |
| 10% | 149 | 5,850 | 38/40 | 19 | 15 | 44.00 | 130 min |
| 30% | 480 | 18,965 | 40/40 | 20 | 17 | 44.00 | 7 h |
| 60% | 895 | 35,532 | 40/40 | 20 | 15 | 44.00 | 13 h |
| 100% | 1,491 | 58,458 | 40/40 | 20 | 21 | 44.00 | 22 h |
We additionally evaluated two complementary baselines using the same interaction-data pool: Raw Trajectory Retrieval, which directly retrieves historical interaction trajectories under a matched context-token budget, and SAM + Fast Downward, which learns symbolic action models for classical planning. As shown below, CausGround achieves 44.00%, outperforming both baselines and demonstrating the effectiveness of structured interaction knowledge compared with raw experience retrieval and learned symbolic planning. We have added the data-efficiency and estimated generation-cost analysis in Appendix D.4, and the Raw Trajectory Retrieval and SAM + Fast Downward comparisons in Appendix D.5 of the revised manuscript.
| Method | Success Rate (%) |
|---|---|
| Raw Trajectory Retrieval | 30.67 |
| SAM + Fast Downward | 12.00 |
| CausGround | 44.00 |
Dear Reviewer zmNx,
As the ICLR 2027 discussion period approaches its conclusion, we would greatly appreciate it if you could share your thoughts on our rebuttal and revised manuscript. We would be happy to discuss and address any remaining concerns.
Thank you again for your time and consideration!
Best regards,
The Authors
We sincerely appreciate your thorough review and insightful feedback. In response to your concerns, we have clarified the distinctions between CausGround and related symbolic planning methods, introduced additional learned action-model and trajectory-retrieval baselines, and provided further data-efficiency and construction-cost analyses. We have also clarified the different levels of causal evidence across environments, supported by additional rule validation. We hope these additional comparisons and clarifications address your concerns and better establish the distinct contributions and practical value of CausGround.
W1: Incremental Contribution Beyond Symbolic Action-Model Planning
We appreciate you for highlighting these closely related works. InterPreT (Han et al., 2024) [1] learns symbolic predicates from human language feedback and action operators from interaction data, while PSALM-V (Zhu et al., 2026) [2] infers symbolic action semantics through visual observations and execution feedback. Both primarily integrate the acquired knowledge into PDDL-based symbolic planning. As detailed in Section 3, CausGround differs from these approaches in two key aspects. First, causal interaction knowledge acquisition: we use controlled factor variations in VirtualHome to test action dependencies and action-conditioned state-transition regularities in RoboCasa and SWITCH. Second, knowledge-grounded MLLM planning: Instead of relying on a symbolic solver, we strengthen a frozen MLLM using retrieved action dependencies grounded in the current visual state. Given the increasingly strong embodied reasoning capabilities of modern MLLMs (e,g., Fable 5.2, GPT-6 Astra), enhancing their planning capabilities with explicit, environment-grounded interaction knowledge represents a valuable complementary direction to traditional symbolic planning.
To further evaluate this distinction, we introduced SAM [3] + Fast Downward [4], a learned symbolic action-model planning baseline, using the same VirtualHome interaction data and 75 evaluation tasks. SAM + Fast Downward achieves 12.0% (9/75) task success, compared with 44.0% (33/75) for CausGround using visual observations. These results provide additional evidence for the effectiveness of our knowledge-grounded MLLM planning framework. We have added the relevant citations and discussion in Section 2, clarified the knowledge acquisition protocols in Appendix C.3.1, and included the learned symbolic planning baseline in Appendix D.5 of the revised manuscript.
W2 & Q2: Causal Grounding and Filtering of Spurious Dependencies
We appreciate the reviewer for highlighting this important distinction. CausGround focuses on grounding action preconditions and effects in environmental interactions, with the strength of supporting evidence depending on the available feedback. In VirtualHome, controlled factor variations directly test action dependencies, achieving 100% rule consistency under these tests. In RoboCasa and SWITCH, we apply counterexample-based filtering: a candidate precondition is removed if the action succeeds without it, while a candidate effect is removed if it does not occur following a successful action under applicable conditions. We further examine the extracted knowledge against the official simulator execution code, confirming 98.1% of preconditions and 98.8% of effects, providing stronger mechanistic evidence for the extracted dependencies beyond observational consistency. For SWITCH, we also evaluate the practical utility of the extracted knowledge through action selection, recovery, and verification tasks (Table 2), while developing a controllable testbed for future interventional validation. We have clarified these distinctions in Appendix C.3.1 of the revised manuscript.