- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OpenRun, a framework for runtime learning in safety-critical open-world environments. OpenRun consists of a Learning-Student with cognitive batch sampling, a Safety- Teacher for safe planning and control, and an Action-Blender that adaptively combines their actions to balance safety and exploration. Experiments on a quadruped robot in real forests and an off-road vehicle in simulation demonstrate improved learning and task performance.
Critical strengths
S1.The paper presents a well-motivated framework that jointly addresses safety and learning efficiency in open-world environments, with theoretical analyses and ablation studies supporting the proposed adaptive blending and cognitive batch sampling mechanisms. S2.The evaluation on a physical quadruped robot in challenging real-world forest environments, together with comparisons against multiple safe RL baselines, provides valuable evidence of the framework's practical effectiveness. S3.The paper is well-organized and clearly written. The motivation is clear. Figures and tables adequately illustrate the proposed framework and experimental results. W1.
Critical weaknesses
W1.The paper lacks sensitivity analyses for several key parameters, including the blending parameter α in Eq. (10) and the cognitive sampling parameters C, c, λ, and ξ in Appendix H.1.3. The authors should evaluate how these parameters affect safety, exploration, and learning performance to demonstrate the robustness of the proposed mechanisms. W2.Appendix H.4 reports the execution frequencies of different modules but does not clearly specify how these frequencies correspond to individual operations such as experience sampling, policy inference, and gradient updates. The paper also lacks quantitative measurements of sampling latency and computational overhead. The authors should clarify the execution schedule and report the corresponding runtime costs. W3.Figure 5 evaluates frequency and recency only as a combined factor (F-R), without examining their individual contributions. The current ablation study does not establish whether the improvements arise from frequency, recency, or their combination. The authors should include separate frequency-only and recencyonly variants to provide a more complete analysis.
Questions for authors
W1-W3
Thank you for your sincere and detailed responses, and for the substantial effort you put into revising Section 4. Your responses have resolved my questions and have partially addressed my concerns about the weaknesses. Before going further, I would like to check: In your response to W1, you state that "Recency-Frequency-Only Sampling addresses only contextual error", and I wonder whether you meant that it addresses only the temporal error.
However, I am still not fully convinced regarding W1 and W4, and I think the main reason is that the definitions of the notation remain unclear.
I suspect that this difficulty comes from the structure of the paper as a whole. Because the paper presents three modules together with their theoretical analyses at the same time, the manuscript feels fragmented. Although theory-driven design is valuable, placing all analyses alongside the method obscures the main message. If you move the theoretical analyses to the appendix and instead use the main text to explain the design rationale of the three modules and how they work together, I believe the paper would be much easier for readers to follow.
In addition, I would encourage you to highlight your real-world experiments more in the main text, as I consider the most notable element of your paper. At present they appear only as links, which makes this contribution look minor. Including highlights from the videos in the experiment section, together with a qualitative analysis alongside the quantitative results, would make the distinctive contribution of your work much more visible. At this stage, I will maintain my initial rating.