- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper presents MorphAdapt, a shared robot controller that combines morphology conditioning with temporal context inference to handle unseen robot embodiments and changing dynamics. A history-based Student learns from privileged Teacher supervision and adapts its inferred context during deployment without updating network parameters.
Critical strengths
Strength: Meaningful problem
The paper addresses a meaningful problem in generalist robot control: enabling a shared policy to handle both unseen robot morphologies and changes in interaction dynamics during deployment. These two sources of variation naturally coexist in practical applications, making their joint evaluation valuable.
Critical weaknesses
Weakness 1: Suspected AI-generated passages and unresolved experimental provenance substantially weaken confidence in the results.
Several passages in Appendices B and H appear AI-generated to me. In particular, unusual wording such as
“A complete Teacher completion record and historical Teacher-to-Student initialization byte receipts are not available; configured values must not be interpreted as measured Teacher completion counts. ”(Line 740-742)
reads like internal AI-assisted auditing commentary, raising concerns about whether these passages were adequately checked before submission.
More substantively, these passages explicitly acknowledge missing Teacher training completion records, initialization records, and some baseline completion/source records. Although the paper discloses AI assistance, these unresolved provenance gaps substantially undermine my confidence in the experimental reliability. The actual training budgets, checkpoint origins, and initialization procedures directly affect the interpretation and comparability of the central results.
Thus, I have assigned the highest priority to this issue, as it significantly influences my assessment of the paper's credibility.
Weakness 2: The contribution of online adaptation to the system-level improvements remains insufficiently established.
MorphAdapt achieves higher mean returns than MetaMorph-DR, but this comparison changes several factors simultaneously, including privileged supervision, Teacher-based initialization, Student distillation, and deployment-time temporal context inference. Consequently, the observed gains do not establish how much improvement comes from updating the inferred context online.
The UPDATE–FREEZE experiment in Section 6.4 provides a relevant intervention, but its results offer limited support for this central mechanism. Given the paper’s emphasis on two-timescale context and adaptation to changing dynamics, stronger evidence connecting online context updates to behavioral gains is needed to establish the distinctive value of the proposed approach.
Questions for authors
Question 1: Please clarify the meaning and origin of these unusual statements, including whether they are AI-generated text retained in the submission. What verification did the authors perform before endorsing them? More importantly, what existing evidence substantiates the completed training budgets, checkpoint provenance, and Teacher-to-Student initialization underlying the main results? (See Weakness 1)
Question 2: Can the authors isolate the contribution of deployment-time context updating within the main mutation benchmark—for example, by comparing live and frozen context using the same trained checkpoint and matched pre-mutation states and randomness? How should the weak UPDATE–FREEZE effect and negative HOLD-relative interaction be reconciled with the proposed adaptation mechanism? (See Weakness 2)
6 comments
Thank you for your response.
Weakness 1: The authors have attempted to provide some information regarding the experiments. While this helps to some extent in establishing the authenticity of the experiments, the overly defensive tone present throughout both the main text and the appendix prevents me from changing my assessment of the work. This same defensive tone also appears in the authors' responses to Weaknesses 1 and 2. I suggest that the authors revise the language in both the appendix and the corresponding sections of the main text to ensure a higher level of academic rigor.
Furthermore, I would like to remind the authors that it is permissible to modify the main PDF during the rebuttal phase; I recommend incorporating these revisions directly into the appropriate sections of the main text.
Weakness 2: The authors state in their response:
These are descriptive results from one training seed; the pooled RETURN median is zero and no uniform per-robot or cross-seed benefit is claimed. The requested same-checkpoint matched LIVE-FREEZE test on the main Mutation benchmark is not yet completed. This repeated-change intervention and the complete-system comparison address different questions; the prepared revision presents them at their respective scopes.
This is confusing.
I would like the authors to explain the implications of the results presented in the rebuttal more directly, and to clarify how this response addresses the questions we raised.
Thank you for the clarification. We agree that our previous response emphasized qualifications before explaining the findings. We address the writing and scientific implications directly below.
Weakness 1 — Presentation and academic rigor. We will revise the main PDF, rather than rely on rebuttal text alone. Section 6.4 will state the ABA finding and its implications before experimental details; Section 7.1 will clarify what the complete-system comparisons and context intervention establish. Appendix E will retain the full results, HOLD control, and exposure definitions while removing repetitive, defensive, and internal-audit-style prose. We will similarly edit the relevant implementation and baseline descriptions. We will state limitations where they affect interpretation, not as substitutes for explaining the results.
Weakness 2 — What the interventions show. Our evidence shows that changing the temporal context supplied to the controller can improve locomotion, and that continued updating helps in some tested cases. It does not yet identify a positive average benefit of online updating across the main benchmark.
ABA: Motor strength changes from 1.0 to 0.8 at index 250 and returns to 1.0 at 550. In [550,800), UPDATE uses the newly inferred context; FREEZE holds the pre-restoration context. The matched HOLD branch retains motor strength 0.8. Across 81 confirmation XML clusters, the mean UPDATE–FREEZE reward difference on RETURN is +0.216 (median 0). Family means are +12.515 (mvt), +4.073 (vt), and −2.989 (floor): the response varies across robot families. The RETURN-minus-HOLD interaction is −2.829; equivalently, the mean updating advantage is +3.045 in HOLD versus +0.216 in RETURN. Thus updating can help in some conditions, but motor-strength restoration does not produce an additional average updating benefit in this test.
GearPatch pilot: We further tested an exploratory intervention that divides the history encoder's gear-feature input-weight columns by 300, without changing actuator gear, the action decoder, or performing policy optimization. The pilot uses four previously evaluated morphologies, evaluation seed 1409, and a 500-step horizon. We compare Original, GearPatch-Live, and GearPatch-Frozen; the latter two share the patch and differ only in whether the decoder receives updated context from decision 250 onward. The full pilot covers 144 episodes across State-only and State+Action, and all 48 patched Live/Frozen pairs have matching pre-freeze traces.
For State+Action, the Mutation Return contrasts averaged over all four morphologies are:
- Seed 1409: Live−Original +712.44; Live−Frozen −50.35.
- Seed 1410: +43.42; −51.41.
- Seed 1411: +402.07; +7.09.
The patched policy therefore improves mean Mutation Return over Original in all three Student runs. The gains include longer survival: +628.00 of the +712.44 gain for seed 1409 comes from additional surviving steps. We also observe a positive within-policy updating case for a seed-1411 mvt robot: Live Return 2757.59 versus Frozen 2542.32, both reaching 500 steps. The original latent is zero in these pilot trajectories, whereas the patched context is nonzero. In same-state probes, reversing earlier history changes the patched latent in 204/205 snapshots; substituting patched for original context changes executed actions in 202/205 snapshots. These are sensitivity probes, not independent robot trials.
Crucially, the Frozen arm retains substantial gains because it retains the patch and the pre-change latent. Thus the large Live−Original gains demonstrate behavioral effects of the context configuration, while Live−Frozen measures the additional value of continued updating and yields mixed results (negative in two of three State+Action seeds). The pilot and ABA also use different interventions and protocols; they are not conflicting estimates of one effect.
Implications and revision. The experiments show meaningful effects of the context pathway and local benefits from updating, but do not establish that continuous latent updates account for the main system-level Return advantage over MetaMorph-DR or R-MoMo. The requested main-protocol LIVE–FREEZE study remains paused because its LIVE replay does not reproduce historical Return; no formal effect is claimed from it. The final revised manuscript will include the GearPatch protocol, all per-seed and per-morphology results, and paired Live/Frozen controls as supplementary material, with the key interpretation incorporated into the main Results and Discussion.
Response to Reviewer 1eXv
Thank you for recognizing the importance of joint embodiment and dynamics variation. We provide specific evidence addressing experimental reliability and deployment-time context updating. The revised manuscript is being prepared for upload.
Appendix wording, AI assistance, and experimental records:
The author wrote the appendices in Chinese. AI assisted with English translation and polishing using existing training records and experimental materials as reference, as disclosed in the AI Use Statement. "Initialization byte receipts" was awkward wording for Teacher-parameter loading records during Student initialization. It was intended to distinguish configured training budgets, recorded progress, and initialization-time documentation. We take responsibility for the wording and are replacing it with standard terminology.
Documented preparation checks for the Chinese draft covered terminology, notation, compilation, references, page inspection, and preservation of table values and figure assets during editing. The submitted supplementary code archive includes implementation details; code describes the implementation, while logs and saved models document executed runs.
Additional post-submission verification establishes the following. All six Students have 99,942,400 recorded Stage-II transitions and 78,080 optimizer updates per run. Original Teacher TensorBoard records extend to 99,778,560 logged transitions. Comparing retained models identifies 131 equal corresponding non-adaptation tensors between each Student and the Teacher. We also verified 6,984 return/episode-length entries against retained evaluation outputs and reproduced 96 checked XML-cluster interval pairs within floating-point rounding.
These checks substantiate Student training counts, saved-controller parameter relationships, and reported statistics. The Teacher's complete optimizer/save history and original initialization-time loading records remain incomplete. We distinguish those historical gaps from verified saved-model relationships and statistical recomputation; neither is presented as a fresh simulator run. The prepared revision replaces the broad missing-record passage with these specific facts.
Behavioral evidence from a same-checkpoint intervention:
UPDATE and FREEZE use the same trained checkpoint, with identical prior Teacher training, initialization, and distillation. UPDATE uses current inferred context; FREEZE holds the controller-facing context at its value immediately before the second dynamics change, while history encoding and the environment continue. The outcome is closed-loop reward accumulated over the specified post-change window, not merely a latent-vector difference.
Existing results show positive mean behavioral effects in two morphology families, even though the pooled effect is small. The full confirmation sets, including negative and zero effects, give these mean UPDATE-minus-FREEZE reward differences under the RETURN schedule and HOLD-relative interactions, respectively: mvt (9 clusters), +12.515 and +5.714; vt (17), +4.073 and +4.582; floor (55), -2.989 and -6.518; all 81 clusters, +0.216 and -2.829. These are the existing morphology groups, not groups chosen by reward outcome. Positive mvt/vt contributions are offset by the larger negative contribution from floor, which accounts for 55 of 81 clusters.
The negative HOLD-relative interaction must be distinguished from the direct updating effect. With D_RETURN and D_HOLD denoting UPDATE-minus-FREEZE reward differences when motor strength returns to A or stays at B, I = D_RETURN - D_HOLD. For the same 81 clusters under equal-cluster averaging, the reported means imply D_HOLD = 0.215574 - (-2.828963) = +3.044537. Hence the negative interaction compares a smaller positive RETURN mean (+0.216) with a larger positive HOLD mean (+3.045), rather than an average penalty from updating in both schedules.
The supported result is positive mean closed-loop effects in some evaluated families, with heterogeneous effects across families and schedules. These are descriptive results from one training seed; the pooled RETURN median is zero and no uniform per-robot or cross-seed benefit is claimed. The requested same-checkpoint matched LIVE-FREEZE test on the main Mutation benchmark is not yet completed. This repeated-change intervention and the complete-system comparison address different questions; the prepared revision presents them at their respective scopes.