- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OrbitRIR, a framework prtraining a generative model for RIR prediction and inversely using the generative model for 3D sound source localization task. In the generative model, they explicitly consider yaw-rotation invariance during generative model training and use panoramic depth map as the 3D room context. In the experiment, they adopt AcousticRooms dataset and compared with several other baselines like FewShot-RIR, FEM-based localization methods and random selection. Experimental results demonstrated their claimed feasibility and advantage of the OrbitRIR method.
Critical strengths
-
The core idea is clearly-presented throughout this paper, enabling me quickly follow OrbitRIR idea while reviewing this paper.
-
The experiment section is well-repsented, given the experimental setting. Alongside the code availability, the authors present the experiment, analysis, ablated study and qualitative visualization in detail.
Critical weaknesses
-
Applicability in Real Scenario: The paper wants to solve 3D sound source localization which is very practical in mobile robots. My main concern comes from the setting in the paper that they rely on the accessibility of direct RIR data. In real scenario, direct RIR data rarely exist, but instead the RIR-effected audio is widely accessible. I thus think the applicability of this paper (in either RIR generation and the reverse 3D sound source localization) is largely limited. A more applicable way is to use real audio (convolved with RIR) to implicitly model RIR for the task (for example, Deep Neural Room Acoustics Primitive, ICML24), so that your method can be applied in real-world setting.
-
Localization Setting: In the localization module, RIROrbits requires a finite set of potential 3D positions, then compare the generated RIR at each potential position with the recorded RIR. In other words, the accuracy of localization depends on the finite potential 3D potions, requiring well-prepared 3D positions candidates.
Questions for authors
-
Can OrbitRIR handle multi-room setting? In complex room setting, for example, the sound source and receiver are placed in different rooms (for example, soundspaces-v2 supported matterport3D data), the panoramic depth map thus can't capture the whole scene, does the method still work or how much performance degradation will be observed?
-
Generalization regarding Few-Shot RIR synthesis. Based on my knowledge, RIR is extremely sensitive to either sound source or receiver position. A small position to them can lead to huge RIR difference. Can the author run experiments to explicitly test OrbitRIR's generalization and robustness regarding source-receiver placement?
Received-Audio Localization, Grid Sensitivity, and Generalization
We address practical applicability, grid sensitivity, and generalization through received-audio, measured-HAA, and multi-room MP3D evaluations.
Table Q1. Known-excitation received-audio localization on MP3D (0.5 m grid). We evaluate 128 held-out source–receiver pairs across four buildings, including 60 same-room and 68 cross-room pairs. All four models are adapted to MP3D with matched training budgets. Results are averaged over three inference seeds.
Table Q2. Sensitivity of analysis-by-synthesis localization to candidate-grid resolution. Results are reported for OrbitRIR on HAA and MP3D. The oracle median measures the distance from each ground-truth source position to its nearest grid candidate. Latency is reported in seconds per query. The MP3D grid-resolution diagnostic is separate from the received-audio comparison in Table Q1.
W1. Applicability to received audio and measured environments.
Direct RIRs are generally unavailable in passive localization (cf. DeepNeRAP [1]); we study active localization with known excitation. We convolve a sine sweep with MP3D RIRs [6,7], deconvolve the received audio, and compare it with predicted RIRs using frozen AGREE. OrbitRIR reaches 29.43% SR@1m versus 29.17% with direct RIR input using the same weights (Table Q1), without retraining. On measured HAA RIRs from four rooms [2] at a 0.5 m grid, OrbitRIR reduces mean error from FLAC's 2.814 to 2.605 m (Appendix G.3). HAA uses RIR observations, not recorded source waveforms.
W2. Candidate-grid dependence.
Candidates are generated from mapped geometry, never inserted from ground truth. On AcousticRooms, a 1.0-to-0.5 m grid improves OrbitRIR SR@1m from 38.3% to 53.1%; at 0.25 m it stays 53.1% despite 7.4× more candidates (724 to 5,354; Table U2). On HAA (Table Q2), refining 0.5 to 0.25 m improves oracle median (0.252 to 0.121 m) and localization median (2.031 to 1.828 m), but SR@1m stays 30.99% while latency rises from 8.253 to 72.796 s/query. MP3D varies non-monotonically. Thus, finer grids reduce discretization error but do not guarantee better localization.
Q1. Localization in complex multi-room environments.
On 128 held-out pairs across four MP3D buildings (60 same-room, 68 cross-room; Table Q1), OrbitRIR achieves the lowest overall median error (2.001 m) and highest same-room SR@1m (40.56%). Yaw-Aug leads overall SR@1m (31.51%), and FLAC leads cross-room SR@1m (26.47% vs. OrbitRIR's 19.61%). OrbitRIR mean error rises from 1.812 m (same-room) to 3.980 m (cross-room), reflecting the difficulty of intervening geometry not visible in the receiver panorama. Cross-room performance remains limited.
Q2. Generalization to unseen source–receiver placements.
Thank you for highlighting the sensitivity of RIRs to changes in source and receiver positions. We extended our evaluation to held-out source–receiver configurations, physically measured acoustics, and cross-dataset transfer to investigate generalization beyond the original AcousticRooms setting.
On 128 held-out MP3D source–receiver pairs (Table Q1), OrbitRIR achieves 2.001 m median localization error, compared with 2.067 m for FLAC and 2.012 m for Yaw-Aug FLAC. On HAA, which contains physically measured RIRs, OrbitRIR achieves 2.645 m mean localization error at 0.25 m grid spacing, compared with 2.844 m for FLAC and 2.924 m for Yaw-Aug FLAC (Appendix G.3). We also evaluate zero-shot transfer from AcousticRooms to MP3D without MP3D-specific adaptation. In this setting, OrbitRIR achieves 3.533 m mean localization error, compared with 3.681 m for FLAC (Appendix G.4).
These results provide evidence of generalization to held-out configurations and different acoustic environments. However, they do not directly quantify the sensitivity of RIR synthesis to small, controlled source or receiver displacements. We therefore distinguish generalization across unseen configurations from local spatial robustness.
References: [1] He et al., ICML 2024. [2] Wang et al., CVPR 2024. [3] Rosinol et al., IJRR 2021. [4] He et al., WACV 2025. [5] Dokmanić and Vetterli, ICASSP 2012. [6] Chen et al., NeurIPS 2022. [7] Chang et al., 3DV 2017.