- Rating
- 2
- Confidence
- 1
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates how the passive dynamics of a physical system can reduce the need for active control. The authors analyze the relationships among Morphological Computation (MC), Policy Compression, and Control Intervention from an information-theoretic perspective. They derive conditions under which MC-based regularization selectively reduces redundant controller information and when such information reduction can translate into lower physical control costs. Experiments are conducted in a custom linear control environment and the DMC Ball in Cup task.
Critical strengths
- Meaningful research motivation. Exploiting a system's passive dynamics to reduce unnecessary control effort is an interesting research problem. The paper also makes a useful conceptual distinction between reducing controller information and reducing actual physical intervention.
Critical weaknesses
-
Limited experimental validation. The experiments are primarily conducted in relatively simple control environments. While the linear control setting demonstrates reductions in control intervention, the improvements in learned policies are more limited. In the DMC Ball in Cup task, no statistically significant reduction in physical control cost is demonstrated.
-
Insufficient validation of the theoretical mechanism in more complex environments. The paper demonstrates selective information compression through MC regularization in a linear control setting. However, the nonlinear Ball in Cup experiment optimizes a passive-dynamics-based information overlap objective (BODY) rather than the original MC objective. Moreover, this experiment does not demonstrate a significant physical control benefit. Therefore, the current empirical evidence remains insufficient to establish whether the proposed theoretical mechanism translates into practical improvements in more complex control tasks.
Questions for authors
-
Could the authors evaluate the original MC regularization objective directly in more nonlinear control environments to further validate the proposed theoretical mechanism?
-
In the DMC Ball in Cup experiment, why does the observed selective information compression not translate into lower physical control costs?
5 comments
Follow up on direct MC validation
Dear Reviewer 76tt,
Following your request, we directly tested the original MC objective in nonlinear control across ten seeds, obtaining 39% less intervention than Compression in pendulum at 10% task degradation. The revision also includes 22 seed Ball in Cup results, an explanation of its information–effort gap, and quantitative alignment tests. We have addressed all your concerns and would appreciate reconsideration of your overall rating in light of this evidence. We remain available for any further questions.
Followup on direct MC validation and robustness
Dear Reviewer 76tt,
With the discussion period about to end in a day and half, could you please indicate whether the direct nonlinear tests of the original MC objective and the expanded 22 seed Ball in Cup study address your concerns about validation and robustness?
We would greatly appreciate your updated soundness assessment and overall recommendation, together with any specific remaining question that we can address before the window closes. We remain available to respond promptly.
Direct nonlinear MC tests, robustness, and the information–effort mechanism
Thank you for recognizing the information–intervention distinction and for requesting direct, replicated nonlinear tests of the original MC objective.
Summary: we now optimize original MC in nonlinear control across ten seeds, with 39% [38,40] less intervention than Compression at 10% task degradation in the pendulum; Ball in Cup now has 22 seeds. The common author comment maps the full revision.
1. Direct tests of the original MC objective.
In pendulum release, gravity supports motion toward the target, pivot damping helps settling, and a separate alignment error still needs active correction. Policies learned with the original behavioral MC objective use 39% [38,40] less intervention than Compression at 10% task degradation across ten independent training seeds, with the advantage in every seed. At 2% degradation, the saving is 18% [16,20] across nine paired seeds. Brackets here and below denote 95% bootstrap intervals. MC removes more body-visible information while retaining more complementary information (Table 1; Appendix B.5, Table 4).
Changing to a freer pivot preserves this selectivity but removes the resolved intervention advantage at 2%. The same task thus tests both parts of the theory: which information MC compresses, and how the body's settling dynamics determine whether that compression yields physical savings.
In the gantry crane, the trolley can coast while its suspended load needs anti-sway correction. Full MC saves 9% [6,11] relative to Compression at 10% degradation across ten seeds; BODY, which isolates the overlap penalty, saves 37% [36,38] (Figure 2; Appendix B.7, Table 9). These experiments directly optimize behavioral MC as well as BODY. Nonlinear information quantities use the declared Gaussian estimates, supported by independent checks in the appendix; intervention in the primary additive noise models is evaluated as transition KL.
2. Replicated Ball in Cup results and the missing physical advantage.
The expanded 22 seed neural policy study includes the original MC objective alongside BODY, Compression, and Direct (Table 3). BODY lowers overlap relative to Compression in 20 of 22 seeds and retains more complementary information in all 22 at the 2% return tolerance. An independent estimator supports the direction of selectivity (Table 1; Appendix B.3). MC also shows no resolved intervention reduction relative to continued task-only training; the revised experiment identifies why.
Approximately 97% of transition KL intervention occurs after the catch, where a nearly constant holding command carries little state information. Information penalties have no direct incentive to remove this expenditure. Direct does, reducing intervention by 96.4% [96.0,96.8] relative to continued task-only training (Table 3). This is a concrete instance of the paper's central distinction: simplifying the state dependence of feedback does not necessarily remove the costly part of actuation.
3. Mechanism validation and the soundness assessment.
The concerns stated in the review concern empirical coverage, replication, and substituting BODY for MC in the original nonlinear experiment. The new direct MC experiments and replicated neural policy study address each of these points.
The theory makes quantitative, testable predictions. Theorem 4 explains why information reduction alone cannot guarantee physical savings. Theorem 5 predicts the direction and leading magnitude of intervention changes near a regular task optimum. The revised quantitative test spans nine pendulum bodies and five objectives. The computed alignment predicts intervention increases in all four negative alignment cases, which the experiments confirm; it also predicts the leading magnitude of intervention changes near the task optimum (Table 5; Figure 7). Proposition 11 and the joint stop experiments additionally address failure of the recoverability condition. Humanoid balance extends the empirical information–effort distinction to articulated contact dynamics (Appendix B.10).
The revision now supports the theoretical account with direct nonlinear MC gains, replicated selectivity, and quantitative tests of when information savings become physical ones. Given these additions addressing the stated basis of the concern, we respectfully request reconsideration of the soundness assessment and overall rating.