- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes an active RGB-D scene reconstruction framework that combines incremental 2D Gaussian Splatting with learned position selection. It maintains a hybrid voxel representation of occupancy and reconstruction uncertainty, with the latter obtained by aggregating per-Gaussian Fisher-based estimates. A PPO policy uses local voxel maps and recent motion history to select target positions, while a separate view scorer chooses viewing directions based on exploration gain and expected uncertainty reduction. This separation reduces the action space handled by the policy. Training rewards encourage surface coverage, spatial exploration, and reconstruction refinement. Experiments under a fixed observation budget show improvements on InteriorGS and competitive transfer to Replica without fine-tuning.
Critical strengths
- The framework addresses a useful planning problem with a sensible design. Active reconstruction needs to balance discovering new surfaces with revisiting poorly reconstructed regions. Combining occupancy and reconstruction uncertainty gives the policy access to both signals. Separating position prediction from viewing-direction selection also makes the decision process easier to formulate and reduces the action space handled by the learned policy.
- The reported results demonstrate useful improvements at the system level. On InteriorGS, the method improves both geometric coverage and rendering quality, with coverage reaching 0.692 and PSNR reaching 24.37 dB. The intermediate-budget results help show how reconstruction develops as observations accumulate. Testing on Replica without fine-tuning is also valuable, as it examines whether the learned policy remains useful outside its training dataset.
Critical weaknesses
- The contribution appears incremental. Voxel-based mapping and Fisher-based view scoring are established ideas, and the added value of PPO is not clearly isolated. The current ablation changes policy inputs, rewards, and view scoring together. My main concern is whether the gains require the learned position policy. A comparison with a greedy or frontier-based position selector using the same maps and view scorer would help answer this.
- Initialization is unclear. The paper mentions a "random valid pose" without explaining how it is sampled or validated. Starting poses and initial observations can affect subsequent exploration. Please clarify the procedure and examine how sensitive performance is to these choices.
- Voxel-resolution sensitivity is missing. The voxel size and its selection are not reported. Coarse voxels may average away uncertainty in small, poorly reconstructed regions. A sensitivity study would help explain how the chosen resolution balances fine-detail refinement, runtime, and memory.
- Efficiency is only partially evaluated. The reported 5.2% concerns uncertainty updates within mapping, rather than the full pipeline. Please provide absolute timings that include policy inference, candidate-view scoring, and path search, alongside a baseline comparison. Offline training cost should be reported separately.
Questions for authors
- Initialization. How are the "random valid poses" sampled and validated, and what initial observations are acquired? Is the same initialization used across methods during evaluation?
- Voxel resolution. What voxel size is used, how was it selected, and is it fixed across scenes? How sensitive is reconstruction quality to reasonable changes in this resolution?
- Efficiency. What is the absolute online runtime, including candidate-view scoring and path search, and how does it compare with the baselines? What is the separate offline training cost ?