- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents CCE-Mobility, a counterfactual world-agent co-evolution framework that enhances LLM mobility agents’ recovery against dynamic environmental changes. It constructs solvable counterfactual scenarios from real trajectories, learns recovery skills from failures, and leverages persistent unresolved failures to guide the world model for better challenge generation. Evaluated on TravelPlanner and MobilityBench, CCE-Mobility greatly boosts counterfactual recovery performance.
Critical strengths
The paper addresses a meaningful problem of adapting mobility agents to dynamic environmental changes, emphasizing recovery from invalidated decisions while preserving the original user intent.
Critical weaknesses
-
The experimental evidence for world–agent co-evolution remains limited. The incremental benefit of world-side evolution is primarily demonstrated on a TravelPlanner validation panel, while the corresponding MobilityBench result is inconclusive.
-
The paper lacks sufficient analysis of how different counterfactual intervention types contribute to recovery improvements. Without intervention-level comparisons, it is difficult to determine which environmental changes provide the most effective learning signals.
-
The gains in recovery scores do not consistently translate into improvements in final task success. This raises concerns about whether the proposed framework improves practical task completion rather than primarily optimizing recovery-oriented metrics.
-
The experiments lack cross-intervention generalization analysis. It remains unclear whether the learned recovery skills transfer to unseen types of environmental disruptions, rather than only improving performance on intervention patterns encountered during evolution.
Questions for authors
-
Could the authors provide intervention-specific experiments comparing recovery performance across different types of environmental disruptions?
-
Could the authors conduct additional experiments using unseen intervention types, either through a leave-one-type-out setting or newly designed disruptions?