- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the value of information about hidden dynamics in a modified Push-T environment with an unobserved friction coefficient. It compares diffusion policies with different information pathways, including friction-blind, true-parameter, estimator-conditioned, and history-conditioned policies, as well as per-friction specialists. The main finding is that online estimation from ordinary task interactions recovers nearly all of the success-rate improvement provided by true-parameter access within the training range. The paper interprets the remaining performance gap as the room for dedicated probing and contrasts this result with a one-push delivery task, where probing improves performance.
Critical strengths
-
The paper makes a useful distinction between the value of knowing a physical parameter and the additional value of deliberately gathering that information. Its emphasis on comparing probing methods against a controller that already adapts during ordinary execution is relevant to experimental practice.
-
The main policy comparisons use paired evaluation conditions and report uncertainty. The estimator is also evaluated on the trajectories generated by the estimator-conditioned policy itself, which strengthens the evidence that the adaptation mechanism works in closed-loop execution. The true, masked, and incorrect parameter-input interventions provide additional evidence that the controller uses the supplied information.
Critical weaknesses
-
The broader insight provided by the empirical findings remains limited. The online-adaptation result in Push-T is useful, but the evaluation is limited to modified Push-T and a simplified delivery task. It remains unclear which task properties make ordinary interaction sufficient, and when dedicated probing provides additional benefit. Consequently, I found it difficult to determine what transferable guidance the study offers beyond the qualitative observation that probing is task-dependent. This limits the significance of the contribution as an empirical study.
-
The experimental evidence supporting the probing conclusion is insufficient. Push-T does not directly evaluate a dedicated probing strategy; instead, the true-input versus online-estimate performance gap is treated as an upper bound, which needs further justification. The delivery comparison changes the controller and estimator and does not count probing costs. These experiments therefore do not isolate whether the opportunity to correct mistakes explains the different outcomes.
Questions for authors
-
I am not sure why the performance gap between the true-input and online-estimate policies should be an upper bound on the benefit of probing. What assumptions are needed for this interpretation? Would it be more accurate to describe it as a reference gap for the particular controller evaluated here?
-
Could you compare these two policies at shorter execution budgets using the stored trajectories? I wonder whether the small gap at 300 steps partly comes from having enough time to correct early mistakes.
-
The Push-T and delivery experiments use different controllers and estimators, and the probing cost is not counted in the delivery task. I am not sure whether the different results can be attributed to the opportunity to correct mistakes. What evidence in the current results supports this explanation?
-
The paper refers to Appendix C for the estimator details, but I could not find the training details there. Could you clarify where these are provided? Also, why do you use different numbers of training seeds for different variants? For variants evaluated with only one or two seeds, I find it difficult to judge whether the reported performance differences are robust across training runs.