- Rating
- 1(−1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper presents FreeMani, a context-based adaptation harness that keeps its actor and reflection models fixed while turning robot observations and execution outcomes into reusable guidance. In a bread-transfer demonstration, the robot takes 144 decisions to complete the first transfer and 26 for the second, illustrating within-session reuse of a tool-use strategy.
Critical strengths
- The work studies physical robot interaction without updating model weights.
- Its interaction traces show how tool discovery, failure recovery, and strategy reuse can unfold in practice.
Critical weaknesses
- Most experiments focus on GPT-6 Astra; Opus 5.5 and GPT-5.6 Sol appear only in small preliminary comparisons, and FreeMani lacks a clearly available implementation and controlled evaluation.
- The paper gives little detail about its data and relies on a few demonstrations, so the evidence feels thin for its broad claims about learning from experience.
- The paper lacks matched post-reset experiments to establish persistent learning or measure a reliable success-rate improvement.
Questions for authors
The second transfer retains the tongs, physical setup, and conversation history, so its lower cost does not isolate learning from those factors?
Response to Reviewer 8joG
Dear Reviewer 8joG,
Thank you for highlighting how the physical interaction traces make tool discovery, failure recovery, and strategy reuse visible in a frozen-model setting. We address your concerns below.
(W2,W3,Q1) Experiments on Learning from Physical Experience
We thank the reviewer for raising the question regarding the claim of learning from physical experience.
Figure 8 and project page Sec “From physical experience to context space adaptation” illustrate an epistemic action experience across three bread-transfer episodes. Each begins with a fresh actor conversation, empty grippers, and both the bread and the tongs outside the tray. In Episode 1, the robot retracts the tongs at 333 s to see whether the tips have captured the bread. In Episode 2, it uses the free wrist camera at 88 s, and the system subsequently retains this strategy. In Episode 3, the actor request contains the retained guidance to reposition the free wrist camera when the tips are obscured. The robot executes that action at 83 s. This trace shows which guidance carried across the reset and how the actor used it.
As suggested by the reviewer,we expanded the evaluation to 12 real-world tasks. Each trial begins with a scene and conversation reset. Overall task success was 5.6% without memory, 52.8% with memory alone, and 63.9% with the proposed method (Figure 5). On three representative tasks, we also compared the proposed method with a condition that retained planning, interaction history, and immediate feedback but disabled lesson retention. Across these tasks, task success was 33.3% without retained lessons and 77.8% with the proposed method (Figure 6). Figure 6 measures the contribution of retaining lessons across the evaluated trials, including reuse within an episode. Figure 8 traces one instance of reuse across episodes. Appendix B defines the physical success criteria, and Appendix E reports the task-level results.
(W1) Implementation Details
We thank the reviewer for asking about implementation details. Section 3 and Figure 4 describe how LEXP connects planning, experience, and action selection. The planner proposes a method for the current subtask. The experience module uses that proposal, recent physical evidence, and retained lessons to generate feedback, which the actor receives alongside its task instruction, current observation, and interaction memory. Section 3.2 describes how the actor’s context is constructed and how action requests are executed. Appendix D.1 specifies the experience-entry fields and update rules, and Appendix F provides the module prompts and structured output formats.
Sincerely,
The Authors