I spent approximately two hours carefully reading this paper, but I still found it difficult to understand its main contributions. To the best of my understanding, the paper aims to address safety concerns arising from the co-evolution of models and their agent harnesses.
I have several major concerns regarding the paper's motivation, positioning relative to prior work, methodological novelty, and overall clarity.
1. Unclear distinction between self-improvement and recursive self-improvement
Throughout the paper, the authors repeatedly emphasize recursive self-improvement (RSI). However, the related work primarily discusses self-improvement and the safety of self-evolving agents, without clearly distinguishing these concepts from recursive self-improvement.
I believe the authors should explicitly clarify the difference between self-improvement and recursive self-improvement, particularly from a safety perspective.
For example, what additional safety challenges arise specifically from recursive self-improvement that do not already exist in conventional self-improvement or self-evolving agent systems? Are there fundamentally different safety considerations when the improvement process becomes recursive?
Furthermore, although the paper repeatedly emphasizes RSI, the related work does not seem to adequately discuss existing research specifically focused on recursive self-improvement.
I would encourage the authors to clarify this distinction and better position their work within the existing RSI literature.
2. Missing relevant literature on harness evolution
My understanding is that the paper aims to address safety under the joint evolution of models and their harnesses. However, I was surprised that the related work does not sufficiently discuss existing research on agent harnesses, harness optimization, or harness evolution.
If harness evolution is a central component of the proposed setting, I would expect a more thorough discussion of prior work in this area.
Additionally, I found the third paragraph of the related work, which discusses representation engineering and constrained updates, somewhat disconnected from the paper's central motivation.
Why are these particular research directions introduced here? How do they directly relate to the safety challenges of joint model–harness evolution?
Without a clearer explanation of these connections, I found it difficult to follow the motivation and positioning of the proposed approach.
3. Unclear benefits of jointly considering model and harness safety
I understand that the proposed algorithm, Sentinel, aims to provide safety guarantees under the co-evolution of models and their harnesses.
However, I am not convinced that the paper sufficiently demonstrates why a joint safety framework is necessary, rather than simply combining existing safety mechanisms for models and harnesses.
For example, suppose we already have two existing algorithms:
- Algorithm A: Provides safety guarantees for harness updates.
- Algorithm B: Provides safety guarantees for model updates.
A natural baseline would be to apply Algorithms A and B alternately during model–harness co-evolution, ensuring that each component is updated using its corresponding safety mechanism.
My main question is: What additional safety guarantees or practical benefits does Sentinel provide compared with this straightforward combination of existing methods?
More specifically, does jointly considering model and harness evolution provide stronger safety guarantees than independently enforcing safety constraints on each component?
I believe this comparison is essential to establishing the novelty and necessity of the proposed method. Without such a baseline or a clear theoretical justification, it is difficult to understand why the proposed joint framework is preferable to existing approaches.
4. Lack of clarity and precise technical terminology
My biggest concern is the overall clarity of the paper.
Even after spending considerable time reading it, my understanding of its central contribution remains limited to the general idea of addressing safety during joint model–harness evolution.
Many sentences use sophisticated terminology, but the underlying technical meaning is often unclear. In several places, the terminology seems insufficiently defined or motivated, making it difficult to understand what the authors are actually proposing.
For example:
- Around line 105: What exactly do the authors mean by terms such as "pre-representation" and "contractual"? Why is the notion of a contract introduced here, and what is its precise technical meaning?
- "Joint safety effect matrix": What does this matrix represent, and how is it formally defined? Its role in the proposed framework is not sufficiently clear.
- Around lines 120–123: The authors introduce "three abstract base model slots." What exactly is a "model slot" in this context? Is this a formally defined component, or simply an informal abstraction?
These are only a few examples. Similar issues appear throughout the paper.
Overall, the writing sometimes feels overly abstract and insufficiently grounded in precise technical definitions. Some passages read as though technical-sounding terminology has been introduced without sufficient consideration of its meaning or necessity.
I strongly encourage the authors to simplify the presentation, carefully define the terminology, and explain the technical motivation behind each introduced concept.
5. Unclear definition of RSI and joint RSI
Another related concern is the lack of a precise definition of RSI in the paper.
The authors repeatedly use the term "RSI," but it is not entirely clear what qualifies as recursive self-improvement in their setting.
For example, around line 130, the authors introduce the notion of "joint RSI." However, what exactly makes the proposed process joint and recursive?
Is any iterative co-evolution of a model and its harness considered joint RSI? Or does joint RSI require a specific recursive dependency, in which improvements to one component enable further improvements to the overall system?
I believe these distinctions are important, particularly because RSI is central to the paper's motivation.
The authors should provide a formal or at least operational definition of RSI and joint RSI, and explain how their setting differs from conventional iterative optimization or model–harness co-adaptation.
6. Limited novelty of the observations regarding safety regression
In Section 3, the authors observe that safety regression can occur when both the model and harness are updated.
However, I found this observation rather intuitive and not particularly surprising.
If we modify only the model or only the harness, the potential sources of safety regression are relatively constrained. In contrast, if we modify both components simultaneously, we naturally introduce additional interactions and expand the space of possible system behaviors.
From this perspective, it seems reasonable to expect that jointly updating the model and harness could introduce additional safety risks.
Even as a reader who is not deeply familiar with the harness safety literature, I did not find this observation particularly unexpected.
Therefore, I would like the authors to clarify what is genuinely surprising or nontrivial about their findings.
For example, do they identify safety failure modes that cannot be explained by simply combining the effects of independent model and harness updates? Are there emergent safety risks that arise specifically from interactions between the two components?
Demonstrating such nontrivial interactions would make the paper's empirical findings and overall motivation substantially more compelling.
Summary
Overall, I believe the paper addresses a potentially important problem: understanding and maintaining safety as both models and their harnesses evolve.
However, I have significant concerns about the clarity of the paper's motivation, its positioning relative to existing research, and the novelty of its proposed approach.
In particular, I would encourage the authors to:
- Clearly distinguish self-improvement from recursive self-improvement and explain the safety implications of this distinction.
- Better contextualize the work within existing research on harness optimization and evolution.
- Demonstrate the benefits of jointly enforcing safety constraints compared with independently applying existing safety mechanisms to models and harnesses.
- Substantially improve the clarity of the writing and provide precise definitions for the introduced terminology.
- Formally clarify what constitutes RSI and joint RSI in the proposed setting.
- Highlight nontrivial safety phenomena that arise specifically from model–harness interactions, rather than relying primarily on intuitive observations.
Addressing these concerns would help readers better understand the paper's technical contributions and assess the significance of the proposed framework.
Rebuttal Time is near End
The Rebuttal Time is near ending. Please upload the rebuttal and i am looking forward to seeing how the authors respond to my concerns.