- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies active scene reconstruction from single-channel RIRs and known poses. It proposes an acoustic world model that jointly reconstructs local wall maps and predicts future acoustic representations. These predictions support trajectory selection through anticipated map improvement and collision checking. Experiments evaluate local reconstruction and closed-loop mapping in simulation.
Critical strengths
- The integration of acoustic reconstruction, future observation prediction, and closed-loop planning provides a coherent approach to active acoustic mapping. The reported reduction in mean collision rate suggests that the integrated predictive planner can support safer exploration.
Critical weaknesses
- The idealized sensing and environment assumptions limit the practical conclusions. (1) The experiments directly use simulator-generated RIRs without evaluating a recording pipeline in which a source signal is convolved with the RIR and corrupted by noise. The existing RIR-level noise experiments do not cover this acquisition and estimation process. (2) Evaluation focuses on empty room or building envelopes, without explicitly considering furniture such as tables and beds or the acoustic effects of doors and windows. The evaluation primarily treats individual rooms as separate reconstruction units, leaving reconstruction across connected multi-room environments underexplored.
- The comparative evaluation does not sufficiently establish the proposed method’s advantage or isolate its contribution. (1) The reconstruction baselines comprise two trajectory-only heuristics and one custom EchoScan-style predictor. Relevant acoustic floorplan reconstruction methods, such as the audio-only variant of AV-Map [1], may be considered for adaptation, retraining, and evaluation under matched conditions. (2) Moreover, a baseline with the same reconstruction architecture, trained without the future-prediction objective, is needed to distinguish the benefits of world-model training from those of the encoder and sequence aggregation. (3) The presentation would also benefit from analyses of how reconstruction performance varies across different conditions, such as room type, floor area, or reverberation time. Such analyses would complement the existing results and help clarify the conditions under which the method performs well or struggles. Videos comparing the complete reconstruction process across methods would also help make their differences easier to assess.
[1] S. Purushwalkam et al., "Audio-Visual Floorplan Reconstruction," 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 1163-1172.
Questions for authors
- EchoScan’s official implementation is publicly available at https://github.com/inmoyeon/EchoScan. Could the authors update the statement that its code is unavailable and verify the fidelity of their adaptation, including the architectural choices, training procedure, and output conversion used for evaluation?
- The main text describes monaural omnidirectional sensing, whereas Appendix A states that acoustic descriptors are computed using the left binaural channel. Binaural rendering includes a head-related transfer function, selecting one ear would retain head-shadow and directional filtering effects and would not be equivalent to an omnidirectional microphone. Please clarify the rendering configuration and discuss the trade-offs involved in choosing monaural sensing over binaural audio, FOA, or a small microphone array.
- Could the appendix be condensed and reorganized around the essential methodological details and findings? It contains numerous large reconstruction figures which occupy substantial space and make it difficult to identify the main findings.
- Could the authors compare their work with MapLearn in terms of the problems addressed, research scope, and reconstruction capabilities, clarifying which aspects represent advances and which involve a narrower scope or reduced capabilities?
7 comments
-
About comparisons, experimental analysis, and presentation.
-
Regarding comparison with AV-Map.
We appreciate the suggestion to consider AV-Map. Its audio-only configuration is relevant to acoustic floorplan reconstruction, and we will expand the related-work discussion accordingly.
AV-Map addresses floorplan and semantic-layout inference from collected observations, while our work focuses on RIR-conditioned local wall reconstruction, active sampling, future acoustic-latent prediction, and closed-loop trajectory optimization with predictive collision evaluation.
We have not performed a comparison with AV-Map, however we do emphasize the extension of AV-Map to our task is non-trivial. A matched empirical comparison would require adapting the acoustic inputs, reconstruction targets, and evaluation protocol that AV-Map is adapted for.
-
Regarding contribution of predictive training.
We additionally train a geometry-only variant with , retaining the acoustic encoder, pose-conditioned temporal model, occupancy decoder, geometric supervision, dataset, and training budget of 300 epochs.
Removing predictive supervision slightly reduces local reconstruction accuracy: Chamfer increases from 0.146 to 0.150 m, while [email protected] decreases from 0.958 to 0.953. Results show modest reconstruction benefit from predictive supervision, future acoustic prediction is primarily motivated by its use in active planning.
-
Regarding reconstruction under different scene conditions.
We extend the evaluation with scene-level analysis across floor area, geometric complexity, and reverberation time (RT60). For each characteristic, all 287 held-out ResPlan scenes are divided into low, medium, and high groups, and reconstruction accuracy is aggregated across five runs.
We observe floor area has little association with reconstruction accuracy: Chamfer remains approximately 0.253 m across all three groups, with [email protected] ranging from 0.687 to 0.698.
Geometric complexity is more associated with reconstruction difficulty. From low to high complexity, Chamfer increases from 0.232 to 0.283 m, while [email protected] decreases from 0.720 to 0.653.
Higher estimated RT60 correlates with better reconstruction in this dataset: [email protected] increases from 0.659 to 0.723, while Chamfer decreases from 0.275 to 0.227 m.
-
Regarding Appendix organization.
We accept the comment and thank the reviewer for raising it. We have uploaded a revised manuscript that prioritizes experimental protocols, controlled ablations, and principal results while unifying repetitive qualitative reconstruction figures.
-
Regarding qualitative presentation. We recognize the value of side-by-side videos showing reconstruction evolution and agent trajectories. To that end, we uploaded a supplementary zip file containing short episodes across different scenes: one comparing CEM variants, another comparing CEM (WM) against non-CEM baselines, and a final video illustrating CEM (WM) trajectory sampling and hallucinations. We hope these videos provide clearer intuition into reconstruction quality and planner behavior.
-
-
About EchoScan implementation.
We correct our statement regarding code availability. The repository's first public commit is from around a year ago, after development of our baseline had begun – therefore we have apparently missed the official implementation’s release. Our adaptation was developed from the published paper.
EchoScan is the closest learned acoustic reconstruction baseline to our setting. We implemented the transferable components and verified that we can reproduce the original method's reported results in its native experimental setting.
In any case it is worth noting that our task requires substantial adaptations because the sensing configurations and reconstruction targets differ. EchoScan uses a fixed multichannel microphone array to infer a filled room floorplan and height. Our setting uses single-channel RIRs acquired along a moving trajectory, explicitly conditions on sensor poses, and predicts local wall occupancy. Accordingly, we adapt the input encoder for single-channel RIRs, incorporate pose embeddings, aggregate information across observations, retain the floorplan branch, and convert its output to the local wall representation used by our evaluator.
The baseline retains the residual acoustic encoding, multi-aggregation principle, floorplan decoding, and MSE plus Dice supervision from EchoScan. The changes to its input representation, aggregation domain, prediction target, and evaluation conversion are documented in Appendix E.2. Because these adaptations materially change the task, we describe the baseline as an EchoScan-style adaptation and not an exact execution of the official implementation on our data.
We have corrected and added missing information in the revised manuscript.
-
About monaural versus binaural sensing.
We thank the reviewer for highlighting the ambiguity in the sensing description. Our reconstruction and planning experiments use omnidirectional, single-channel RIRs. The left channel of separately binaurally rendered RIRs mentioned in Appendix A is used exclusively for supplementary acoustic statistics and is not provided to the reconstruction model or planner.
The reconstruction and planning experiments therefore use no binaural head-shadow effects or HRTF-based directional filtering. We have revised Appendix A to distinguish the omnidirectional model inputs from the binaural recordings used for statistical characterization and document their respective rendering configurations.
-
About comparison with MapLearn.
MapLearn is an acoustic floorplan reconstruction approach that uses propagation-aware learning to infer geometry from recordings collected along known trajectories.
Our contribution focuses on active sampling, future acoustic representation prediction and its integration into closed-loop sensing decisions through imagined occupancy maps, collision-aware trajectory selection, and information-seeking exploration.
We have clarified our positioning away from MapLearn in the revised version.
We thank the reviewer for the thoughtful review. We wish to address raised concerns.
About acoustic acquisition and environmental scope.
Regarding realistic acoustic acquisition.
Our sensing setup assumes an active acoustic source: the robot emits a short acoustic impulse and records the resulting response, providing a direct means of measuring an RIR. Practical excitation signals have finite bandwidth, and recordings are affected by noise and measurement artifacts. Our existing RIR-level noise experiments characterize sensitivity to additive acoustic measurement errors.
The underlying layouts are derived from real-world scans, panoramic observations, and residential floor plans, while acoustic propagation is simulated using SoundSpaces 2.0, which has previously been evaluated against measured RIRs and shown to reproduce key room-acoustic characteristics in real environments.
To further evaluate acquisition effects, we introduce a simulated measurement pipeline in which a known exponential sine sweep is convolved with the simulated RIR, recording noise is added at specified SNR levels, and the RIR is recovered through regularized deconvolution. The resulting estimated RIR is provided to the unchanged reconstruction model.
Reconstruction remains close to the clean baseline at recording SNRs of 20-30 dB, with increasing degradation at lower SNRs. This experiment evaluates excitation, noisy recording, and inverse filtering under controlled conditions. It assumes known excitation and linear acoustics.
Regarding furniture and multi-room environments.
Our evaluation includes geometrically diverse room and apartment envelopes, including nonconvex layouts, but does not model furniture, heterogeneous acoustic materials, or the detailed effects of doors and windows. The reconstruction targets focus on room and apartment boundaries, with internal apartment subdivisions omitted.
Internal clutter introduces additional reflections and occlusions, while connected rooms involve more complex acoustic propagation and topology. We will clarify that the present study evaluates predictive active acoustic mapping under controlled geometric assumptions, with furnished, connected buildings deferred to future work - mostly because of the difficulty in acquiring such diverse data accurately and at scale.