- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces an extension of Go-Explore that uses the topology of previously visited states to guide exploration. Specifically, it identifies enclosed but unexplored regions and increases the probability of selecting states along their boundaries, while gradually deprioritising unsuccessful exploration attempts. The method improves exploration efficiency on the authors' TopoGym benchmark, but shows no meaningful improvement over Go-Explore on Montezuma's Revenge without additional heuristic signals. The authors also demonstrate that trajectories generated by their method can improve the performance of a fine-tuned navigation policy, although the gains are relatively modest and limited to unseen environments rather than unseen goal categories.
Critical strengths
-
The central idea of using the structure of previously visited states to guide exploration is intuitive and reasonably well motivated.
-
The method builds directly on Go-Explore, making it relatively straightforward to isolate the contribution of the additional exploration signal.
-
The results on TopoGym show consistent improvements in both exploration efficiency and the number of environments solved.
-
The paper provides extensive theoretical analysis and diagnostic experiments, including investigations of where the proposed signal is effective and where it fails.
Critical weaknesses
-
The strongest results come from TopoGym, a benchmark developed by the authors that specifically includes environments with the topological structures their method is designed to exploit. It remains unclear how well the approach generalises to less structured environments.
-
The experiments on Montezuma's Revenge are not particularly convincing. The original method does not improve performance, while the only statistically significant improvement comes from adding texture-based heuristics. Without a Go-Explore + texture baseline, it is impossible to attribute this improvement to the proposed topological signal.
-
Several of the largest improvements in the synthetic experiments come from the additional Ricci curvature signal rather than persistent homology itself. This makes it difficult to assess how much of the reported benefit comes from the paper's central contribution.
-
The embodied navigation results are relatively weak. Although the method improves success from 15% to 18% compared with frontier exploration on unseen scenes, the absolute success rate remains low.
-
Despite the extensive mathematical formulation, it is unclear whether persistent homology offers a meaningful advantage over simpler exploration heuristics. In particular, the TopoGym implementation already uses information about observed but unvisited free space, yet the paper does not compare against a simpler frontier-based method exploiting the same information.
Questions for authors
-
How much of the improvement on TopoGym specifically comes from identifying enclosed regions, rather than simply prioritising states adjacent to observed but unexplored free space? Could a simpler frontier-based heuristic achieve similar results?
-
Why is there no Go-Explore + texture baseline for Montezuma's Revenge? Given that the authors attribute most of the improvement to the additional door and key features, this seems essential for isolating the contribution of persistent homology.
-
How well would the proposed approach generalise to environments where unexplored regions do not form enclosed structures? Is there evidence that the topological signal offers an advantage beyond the environment families explicitly considered in the paper?
Thanks To All
We thank all three reviewers for careful and constructive reviews. Three concerns came up in more than one review, and we address them together here.
First, whether persistent homology itself drives the gains. Reviewers 4DDi and mZSv asked how much of the improvement comes from detecting enclosed regions rather than from simpler signals. We agree this is the central question. The revised version will add three ablations: a frontier-based baseline that prioritizes archived states adjacent to observed but unvisited free space, using the same information TopoExplore has in TopoGym; Go-Explore with the texture signal and no homology term; and a separation of the homology term from the Ricci curvature term in every synthetic experiment.
Second, the theoretical guarantees. Reviewer mZSv identified real gaps in the statement of Theorem 3 and in what the attempt budget certifies. We will restate the theorem with its assumptions explicit and narrow the claims to what the proof supports. Details are in our reply to mZSv.
Third, benchmark and baseline coverage. Reviewers 5AsR and 4DDi noted that the strongest results come from TopoGym, which we built, and that the RND and ICM baselines are dated. The revision will evaluate on publicly maintained environments, including continuous-control mazes, and compare against current hard-exploration methods.
These changes are too substantial for the discussion period, and we will incorporate them in a revised submission. We are grateful for reviews that make the path forward clear.