1. The significance and novelty of the central research question are not convincingly established.
The maintenance of reusable skills is a legitimate problem. Changes to a skill may affect the policies that depend on it, and existing work has already considered related difficulties. SIL-C studies compatibility between evolving skills and downstream policies (Lee et al., 2025); Partial Models addresses adaptation to local changes in the environment (Alver et al., 2025); and CHiRP investigates learning and reusing options across tasks (Nayyar & Srivastava, 2025).
The narrower question considered here is whether downstream validation costs should influence which options receive additional probes. This is a reasonable idea, but its underlying principle is familiar: additional evidence is worth collecting when its expected benefit exceeds its cost. Cost-sensitive test selection has been studied in active learning, for example by Golovin et al. (2010). These papers do not solve the exact problem formulated here, but they make it important to establish what new understanding this particular formulation provides.
I find that distinction insufficiently developed. Section 2.2 defines the acquisition rule by comparing expected savings in downstream validation work with probing costs. The authors also report that a generic downstream-loss implementation, given the same graph and information, produces exactly the same decisions. The example involving shared downstream services is useful, but the resulting dependence between probes follows from how validation costs are defined. Although the paper documents several useful empirical distinctions, I do not think it develops the topology-dependent acquisition effect into a sufficiently general explanation or predictive principle.
My main concern is therefore not that the maintenance problem is artificial or nonexistent. Rather, the paper does not show why this particular evidence-acquisition decision is an important unresolved bottleneck in continual learning, or what substantial insight it contributes beyond applying established principles to a dependency graph.
References
Safa Alver, Ali Rahimi-Kalahroudi, and Doina Precup. Partial models for building adaptive model-based reinforcement learning agents. In Proceedings of the 3rd Conference on Lifelong Learning Agents, volume 274 of Proceedings of Machine Learning Research, pages 959–977, 2025.
Daniel Golovin, Andreas Krause, and Debajyoti Ray. Near-optimal Bayesian active learning with noisy observations. In Advances in Neural Information Processing Systems, volume 23, pages 766–774, 2010.
Daehee Lee, Dongsu Lee, TaeYoon Kwack, Wonje Choi, and Honguk Woo. Policy compatible skill incremental learning via lazy learning interface. In Advances in Neural Information Processing Systems, volume 38, 2025.
Rashmeet Kaur Nayyar and Siddharth Srivastava. Autonomous option invention for continual hierarchical reinforcement learning and planning. In Proceedings of the AAAI Conference on Artificial Intelligence, 39(18):19642–19650, 2025.
2. The key experiments do not establish that the proposed acquisition rule addresses an important practical problem.
The evaluation covers several control environments and includes experiments on released research systems. However, much of the evidence comes from option targets, changes, dependency structures, and maintenance protocols specified by the authors. These experiments can show that the implementation behaves as intended, but they provide limited evidence that the proposed acquisition problem is consequential in naturally evolving task streams.
This distinction matters most in Section 5.2 and Appendix G. Across 96 CARL PointMass worlds, topology-conditioned acquisition reduces the calibrated maintenance-cost objective by only 0.9% on average. In 78 worlds, topology does not change the acquisition decision. Of the remaining 18, additional probing reduces the validation closure in nine worlds; in the other nine, it adds probing cost without reducing validation work. The preregistered composite confirmation also fails because one world does not meet the option-reliability requirement.
More importantly, the reported acquisition saving combines selected probing actions with source-calibrated downstream validation costs, rather than separately executed downstream maintenance for each acquisition policy. The experiment does not execute each acquisition policy's subsequent maintenance process separately and measure the resulting operational cost. The result supports the proposed decision rule under the specified cost model, but its practical significance remains uncertain.
The experiments on released systems answer somewhat different questions. The 4.17% executed-action saving in SIL-C demonstrates dependency-local revalidation, not the added value of topology-conditioned evidence acquisition. Moreover, the two policies kept callable during validation both achieve 0/20 full-task success; what is preserved is their partial-task execution. Appendix I.1 also reports a continuation experiment in which a successfully repaired option is never invoked. The maintenance intervention incurs 66,476 additional actions without changing subsequent continuation behavior.
These findings do not mean the proposed approach can never be useful. They do mean that the paper has not shown when its main acquisition rule provides a meaningful benefit in an actual learning and maintenance process. Given the limited methodological novelty, I find this a substantial gap. The issue is not the absence of more benchmarks or a new state-of-the-art result, but the lack of decisive evidence for the paper's central contribution.