- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper train an RGB-only exploration agent in Habitat using what they called curiosity. During their training, the reward is taken from the persistent 3D GS-reconstruction built with depth and pose. The agent gets rewarded for views the reconstruction simply cannot predict. The policy is a transformer over past frames, so at test time it needs no depth, pose, or map. In results, it beats RGB-based ANS and OccAnt, and fine-tunes well on apple picking and image-goal navigation.
Critical strengths
Using a privileged reward model only in training and dropping it at deployment is simple and sounds practical. Matching depth-based OccAnt without any depth at test time is a genuinely useful result, and the memory ablations are clean.
Critical weaknesses
The reward is basically a coverage reward computed with ground truth depth and pose. The reconstruction is near perfect on seen regions, so “curiosity” here just means “go somewhere new.” The paper never compares against a simple new-voxel reward or standard novelty baselines like RND or E3B, so there’s no evidence that the 3DGS formulation is doing anything the simpler version wouldn’t.
The evidence might be not complete enough. There’s one training, the gap to OccAnt-RGBD is 0.3 points, and without any fine-tuning the agent already hits 48% on image-goal navigation. That number suggests the downstream task might mostly just rewards coverage.
Questions for authors
- How does your reward compare with a simple coverage reward from the same depth and pose, and with RND or E3B?
- Does image-goal success require the agent to stop?
- Can you report a few training seeds for the main results?