- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
SelfSkill represents existing embodied agents through self-state-conditioned weights over semantic and geometric movement factors. It uses these representations to analyze behavior and guide navigation, reporting improvements on ObjectNav and OVMM.
Critical strengths
The self-state-conditioned representation offers a useful way to compare agents beyond aggregate success rates.
The intervention gains are consistent across benchmarks
Critical weaknesses
The skill-ranking reward does not credit progress toward eventual success. Nonterminal exploration and recovery fragments receive only a step penalty, so useful behavior can be scored no better than ineffective behavior. This undermines the ranking used to select complementary skills.
The central benefit of self-state conditioning is not established experimentally. The paper shows improvements from the complete intervention, but never compares against the same factor model and expert trajectories with weights shared across self-states. (Section 3.4 introduces state-specific activation patterns; Tables 3–4 test regularization and intervention weights rather than removing this conditioning.)
Questions for authors
How does the reward distinguish successful exploration or recovery from unproductive motion before goal completion?
How much do self-state-specific weights improve prediction and downstream success over a shared weight vector fitted to the same data?
3 comments
(W2 & Q2) Self-state-specific Weights vs. a Shared Weight Vector
To address this concern, we introduce a controlled comparison, where both variants use training data, and activation inference objective to get BasicSkill with State-specific Activation and Shared Activation. The only difference is whether activation weights are estimated separately for different self-states or shared across all self-states.
Specifically, the state-specific variant estimates a separate activation vector for each self-state: where denotes the original activation inference objective evaluated on trajectory fragments belonging to self-state . In contrast, the shared-weight variant pools trajectories from all self-states and estimates a single activation vector:
\arg\min_{{\alpha}} \sum_{S\in\mathcal S} \mathcal L_S({\alpha}).$$ We evaluate both variants from two complementary perspectives: 1. **Behavioral prediction:** We compare motion reconstruction error on held-out trajectory fragments to examine how well each representation explains the observed behavioral differences. 2. **Downstream navigation performance:** We use the resulting activation representations in the same skill-aware policy fusion or intervention procedure, and compare navigation Success Rate (SR) and SPL under identical evaluation settings. **Table 2. Comparison between State-specific and Shared Activation Weights on HM3D-v1. Fusion and Intervention represent the downstream methods: VLFM+ApexNav and ApexNav+BasicSkills, respectively.** | Variant | Reconstruction Error ↓ | (Fusion) SR (%) ↑ | (Fusion) SPL (%) ↑ | (Intervention) SR (%) ↑ | (Intervention) SPL (%) ↑ | |---|---|---:|---:|---:|---:| | Shared Activation | 0.66 | 55.2 | 26.9 | 57.0 | 30.4 | | State-specific Activation | 0.37 | 60.4 | 33.2 | 62.2 | 33.7 | This comparison directly isolates the contribution of self-state-specific activation patterns. Improvements in both behavioral prediction and downstream navigation performance demonstrate that distinguishing embodied conditions provides benefits beyond using a shared set of behavioral weights.I appreciate the detailed rebuttal, which addressed most of my concerns. However, reading upon rebuttal and concerns from other reviewers. This seems to be a substantial revision to address all weaknesses. So I'll keep my original rating.
We thank the reviewer for raising these important concerns.
(W1) Clarification of the Reward Formulation
SelfSkill discovers interpretable behavioral strategies by constructing a behavioral basis space and inferring the activation patterns of different behavioral factors under various self-states. These learned representations also provide the foundation for evaluating candidate policies in the subsequent skill-aware policy fusion.
We apologize that the original manuscript did not fully describe the reward formulation used in our experiments, which consists of three complementary components: task completion outcome, step penalty, and BasicSkill-guided motion alignment:
R_k^{\mathrm{success}} + R_k^{\mathrm{step}} + \lambda_a R_k^{\mathrm{align}}.$$ The first two components evaluate task completion and execution cost, respectively. More importantly, the alignment component directly connects policy evaluation with the behavioral representations learned by SelfSkill. Specifically, BasicSkill denotes a set of skills derived from optimal paths collected on the training dataset. To construct a reference motion representation, we leverage the behavioral basis instances and the BasicSkill activation vector $\boldsymbol{\alpha}_k^{\mathrm{Basic}}$ learned by our method: $$\hat{\mathbf v}_k^{\mathrm{Basic}}= \mathbf F_k \boldsymbol{\alpha}_k^{\mathrm{Basic}},$$ where $\mathbf F_k$ represents the behavioral basis instances associated with fragment $k$. For a fragment generated by policy $\pi$, we extract its actual motion representation $\mathbf v_k^\pi$. The alignment reward is then defined as: $$R_k^{\mathrm{align}}= \frac{ (\mathbf v_k^\pi)^\top \hat{\mathbf v}_k^{\mathrm{Basic}} }{ \lVert\mathbf v_k^\pi\lVert_2 \lVert\hat{\mathbf v}_k^{\mathrm{Basic}}\lVert_2+\epsilon }.$$ This component measures the consistency between the actual behavioral tendency of a candidate policy and the reference behavioral patterns represented by BasicSkill in the SelfSkill space. Importantly, this establishes a direct connection between skill discovery and policy evaluation: the behavioral basis space and activation representations learned during skill discovery are reused to construct a skill-based reference for evaluating candidate policies. Therefore, the alignment reward is not an independent, manually specified motion heuristic, but an evaluation signal grounded in the behavioral representations learned by SelfSkill. We emphasize that this reward does not introduce an additional optimization objective for the skill activation vector. The original fitting procedure of $\boldsymbol{\alpha}$ remains unchanged. The learned BasicSkill activation vector is only used to construct the reference motion representation. We will explicitly clarify the complete reward formulation and its connection to skill discovery in the revised manuscript. --- ### (Q1) The Reward Distinguish Successful Exploration or Recovery from Unproductive Motion We clarify that nonterminal trajectory fragments do not receive only a step penalty. Fragments belonging to successful episodes receive the shared episode-level success reward, while all fragments are additionally evaluated through their individual alignment rewards. The two signals serve complementary purposes. The success reward provides global task outcome feedback, whereas the alignment reward provides local behavioral feedback by measuring the consistency of each fragment's actual motion with the BasicSkill reference representation. Consequently, even when an exploration or recovery fragment does not directly approach the goal, it can still receive a positive alignment reward if its motion is consistent with the behavioral patterns represented by BasicSkill. In contrast, motion that deviates from these reference patterns receives a lower alignment score.