- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper asks whether an embodied agent can predict, before acting, which target-state directions a candidate action will make identifiable. The authors show theoretically that scalar summaries like trace or effective rank are insufficient for such directional decisions. They then propose the Epistemic Forward Model (EFO), which predicts post-action identifiability geometry from interaction history and a candidate action. In Habitat experiments, EFO improves rank prediction over action-free baselines and reduces directional regret when scalar scores collide.
Critical strengths
The paper’s main strength is its problem formulation. Instead of predicting future observations or scalar information gain, it makes action-conditioned post-action identifiability geometry an explicit predictive target, asking which target-state directions a candidate action will make identifiable. This framing sits between scalar active-sensing scores and full world models. The accompanying analysis gives a clear motivation for why directional structure, and not just its scalar summaries, can matter for sensing decisions. I find this perspective fresh and potentially useful for the active perception community.
The experimental design is also careful. Shifted-action inputs test whether the model actually uses action correspondence, and swapped-history inputs test whether it relies on the correct history. Applying full-matrix and scalar policies to the same EFO predictions isolates the value of retaining orientation. The decoder ablation directly supports the compositional design. These controls make each claim more interpretable than a simple comparison against baselines would.
Critical weaknesses
All experiments use a single Habitat layout, a four-dimensional target pose, and six discrete actions, with only 285 checkpoints and 19 test trials per fold. There is no cross-scene evaluation and no closed-loop sensing task, so it is unclear whether the findings generalize beyond this controlled setting.
The paper emphasizes that directional structure matters beyond scalar summaries, but the data suggest this is rare in practice. Rotation-only switches occur at only 0.7% of checkpoints, and same-rank scalar collisions make up about 2% of action pairs. The headline regret reduction (0.222 to 0.083) comes from 22 teacher-selected pairs across three blocks, while the effect is near zero across all same-rank pairs. As a result, the evidence that directional prediction meaningfully improves sensing decisions remains limited.
Questions for authors
-
All experiments use a single Habitat layout, and the controlled shifts are small variations within that layout. How does EFO perform when trained on some scenes and tested on unseen layouts with different target objects, occluder configurations, or room geometry?
-
The current setup uses a four-dimensional target pose, six discrete actions, and 285 checkpoints. How would the approach scale to higher-dimensional state, such as full 6-DoF poses or multiple targets, and to larger or continuous action spaces? Given the dimension lower bound in Theorem 1(iii), do you expect the structured decoder to remain learnable with comparable data in these settings?
-
Rotation-only switches occur at only 0.7% of checkpoints, and same-rank scalar collisions make up about 2% of action pairs. This suggests that most action dependence in this benchmark comes from rank changes, which scalar summaries such as effective rank can already capture. Can you identify settings where purely directional distinctions are more frequent? Is there evidence that the advantage of full-matrix prediction grows in those settings?
-
The regret reduction from 0.222 to 0.083 comes from 22 teacher-selected pairs, while the effect across all 3,104 same-rank pairs is near zero (0.0011, CI crossing zero). In a realistic sensing pipeline where collisions are not pre-identified, how much would retaining directional structure improve overall decisions? Could you report the end-to-end benefit on the full decision population, or in a closed-loop task?