- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces ParallelWorld, a framework for enhancing the decision making performance of embodied agents through test-time search in simulation / world-model. Evaluated on two simulated benchmarks, the method shows improved performance compared to baseline methods that do not perform test-time search.
Critical strengths
- The empirical results show that the method leads to increased performance on simulated domains.
- The use of agents to prune down search branch seems interesting.
Critical weaknesses
-
The idea itself is pretty trivial - if you have access to a model of the environment then you can do search. This is essentially a simple form of model-predictive control, and the community has known for a very long time that with a good enough model we can get performance boosts. It is not clear what novel insight this paper contributes other than showing that this works with an agent-based policy.
-
It seems that for this method to work, an accurate model is required. However it is unclear how we can get an accurate world model / simulator for real-world applications such as on real robots, limiting the applicability of the method. There is also no real-world evaluation of the method.
-
In the ESI-Bench results, the agent can directly access the ground truth state and the ground truth environment. This is an unrealistic assumption for most real-world domains and should be explicitly discussed.
-
The inference time cost is a big concern in my opinion, especially since the agent is also involved in pruning the search branch, which will add more inference time. With such a high inference cost, it is not clear whether the framework can be extended to real systems.
-
The experiments lack comparison against alternative planning methods given the same simulator or world-model access. It is not clear whether the introduced search mechanism is needed at all.
-
No statistical significance or variance estimation is provided
Questions for authors
See weakness.