- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces PHILAC for synthesizing room impulse responses (RIRs) at unobserved source positions. The input is a set of ordinary, unlocalized monaural recordings from the same fixed receiver, a receiver-centered depth panorama, and a target source coordinate. The dry signals and source positions of the context recordings are unknown. PHILAC adopts two-stage generation: a query-conditioned energy-decay planner predicts the target decay profile, then a masked discrete-diffusion renderer fills in the RIR waveform as acoustic codec tokens. Experiments report improvements on six acoustic metrics over adapted baselines on unseen synthetic rooms (AcousticRooms dataset) and zero-shot transfer to four measured rooms (HAA dataset).
Critical strengths
S1. The problem setting is meaningful. Replacing calibrated context RIRs with ordinary, unlocalized recordings substantially reduces the acoustic measurement burden at inference time. The combination of blind acoustic context and known query geometry is practically relevant to fixed-viewpoint audio editing and AR/VR rendering. Using depth as the geometric input is also well motivated: room geometry is often far cheaper to obtain than impulse-response measurements.
S2. The paper has well-motivated architectural decomposition. Separating decay estimation from waveform generation provides an interpretable intermediate representation that can be independently inspected and supervised. Permutation-invariant context aggregation, monotone decay planning, and geometry-derived temporal alignment are reasonable inductive biases. The formulation appropriately acknowledges that the available observations do not uniquely determine fine-scale waveform details, giving a principled motivation for a generative model.
S3. Consistent empirical improvements within the reported protocol. PHILAC improves all six reported metrics on unseen synthetic rooms, with a 19.5% reduction in mean EDC error over the strongest evaluated baseline. Increasing the number of unlocalized recordings from K=1 to K=8 consistently improves performance across all metrics (Table 3), directly supporting the claim that unlocalized recordings accumulate useful room evidence. The real-room improvement persists under equal room weighting (Table 12), and the source-domain and noise experiments (Tables 8, 13) provide useful evidence about generalization boundaries and failure conditions.
Critical weaknesses
W1. The experiments do not sufficiently test whether the model reconstructs a spatially consistent acoustic field.
The paper shows that pointwise acoustic statistics improve, but does not establish that the model recovers spatial structure, e.g., occlusion-aware, position-to-position variation that distinguishes a true acoustic field from a room-average response scaled by distance. Three specific gaps: (a) Could distance alone explain the spatial trends? A simpler model that learns a single room reverberation tail and adjusts direct-to-reverberant ratio by source–receiver distance would also produce DRR maps that look higher near the receiver and lower far away. To rule this out, the evaluation needs queries at similar distances but different directions or visibility, compared against a distance-only baseline. The geometry ablation (Table 5, EDC 2.660 --> 3.998) confirms the branch helps, but does not tell us whether the gain comes from room-scale cues or from fine-grained wall/occlusion awareness. Whether this ablation was retrained is also unclear. (b) What happens when context recordings come from mixed propagation conditions? Real recordings are not all alike: some may have strong direct sound, others may be fully occluded. The model aggregates them with permutation-invariant attention, but this does not guarantee it separates room-level properties from path-specific effects. A small controlled test would show whether the model extracts transferable room evidence or is biased by the input distribution, specifically (Line-Of-Sight(LOS)-only contexts, Non-Line-Of-Sight(NLOS)-only contexts, and a mix, each evaluated on both Line-of-Sight (LOS) and Non-Line-Of-Sight (NLOS) targets. The Real Acoustic Fields 1 dataset is well suited here: it has acoustically distinct connected spaces (large soft-walled room vs. small concrete room), occluded source positions, and measurable T60/DRR differences across regions. (c) Are neighboring predictions consistent along a trajectory? Each query is generated independently (acknowledged in Appendix E). Shared room tokens provide a common condition, but independent sampling of reflections and reverberation detail can still produce discontinuities from one position to the next. A dense-trajectory evaluation would directly test this, e.g. checking whether predicted changes in arrival time, early energy, and gain match the ground truth's changes. The concern is especially relevant to the paper's motivation of rendering moving sources.
W2. The paper does not show that audio rendered with its predicted RIRs is perceptually closer to the real target.
The reported metrics capture decay and energy-ratio statistics but do not directly assess what a listener hears. Two RIRs with identical EDC can sound noticeably different. This gap is especially consequential because the model uses stochastic generation to fill in waveform details the conditioning does not determine, yet Table 5 shows deterministic decoding achieves comparable or better scores on most metrics. Without perceptual evidence, the practical benefit of the stochastic sampling remains unclear.
W3. The evaluation metrics can hide important reconstruction errors.
The six reported metrics primarily measure decay characteristics and energy ratios. All six are invariant to global gain scaling: multiplying an RIR by any positive constant leaves normalized EDC, T60, EDT, C50, and DRR unchanged. A prediction can therefore achieve excellent scores across all metrics while rendering the source at the incorrect loudness level. This is a concrete gap because the model explicitly predicts a gain token, yet no metric validates it.
[1] Chen et al. "Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark", CVPR 2024.
Questions for authors
Q1. Spatial validity beyond distance (W1). Can the authors evaluate queries at similar source–receiver distances but occlusion conditions and compare against a room-and-distance-only baseline? Please also clarify whether the geometry ablation (Table 5) is retrained and which coordinate/delay inputs it retains.
Q2. Heterogeneous context paths (W1). Could the authors provide a small controlled evaluation, e.g., using Real Acoustic Field Dataset as a real-world testing dataset, with input condition LOS-only, NLOS-only, and mixed contexts, reporting results separately for LOS and NLOS targets?
Q3. Perceptual quality (W2). Do the acoustic-metric improvements translate into perceptually more faithful rendered audio? A blind listening comparison using the same dry signals convolved with measured and predicted RIRs would directly address this., i.e., comparing PHILAC, the strongest baseline, and the deterministic variant on both LOS and NLOS targets. At minimum, are audio examples available?
Q4. Gain validation (W3). Since the model explicitly predicts a gain token, why is no loudness or gain-error metric reported?
4 comments
Response to Reviewer TGJ2 II
W2 & Q3(a): Perceptual quality
To directly evaluate perceptual quality, we conducted a blinded MUSHRA listening study (ITU-R BS.1534) with 12 participants across 12 trials spanning Speech, Music, and RIR stimuli, comparing Philac, FLAC, EigeNet, and the Hidden Reference on a 0–100 perceptual similarity scale. All 12 participants passed the hidden-reference screening check (rating the Hidden Reference on every trial):
| Condition | Mean (95% CI) | Std | Range | Quality Tier |
|---|---|---|---|---|
| Hidden Reference | 2.45 | 90–100 | Excellent | |
| Philac (Ours) | 5.68 | 74–96 | Excellent | |
| FLAC | 11.42 | 52–91 | Good | |
| EigeNet | 15.94 | 25–85 | Fair |
Philac reaches the Excellent perceptual quality tier and outperforms the strongest baseline FLAC by +9.02 points with substantially lower variance across listeners and stimuli. We have included the full MUSHRA results and evaluation protocol in Appendix C.4 (Table 11 and Figure 9), and interactive audio examples are available in the paper.
W2 & Q3(b): Role of Stochastic Sampling
As also noted by FLAC (Brunetto, 2026), sparse acoustic observations leave fine late reflections underdetermined. Table 5 and Table 2 reflect a clear operating tradeoff between deterministic and stochastic decoding:
- Early geometry vs. late decay in Table 5: Deterministic decoding slightly favors early-energy ratios anchored by query geometry, reaching 1.857 dB and 1.733 dB DRR versus 2.031 dB and 1.831 dB. Stochastic sampling improves full and late decay, lowering EDC from 2.771 to 2.660 dB and Late EDC from 3.330 to 3.216 dB by avoiding mode averaging in the reverberant tail.
- Test-time selection in Table 2: A stochastic conditional distribution enables Best-of- blind selection with , which outperforms deterministic decoding across both early and late metrics: 2.543 dB EDC, 3.095 dB Late EDC, 17.56% , 1.764 dB , and 0.0848 s EDT.
W3 & Q4: Validation of absolute gain and loudness
We agree that the six normalized metrics in the main tables are invariant to global scaling and do not validate the predicted gain token . We therefore evaluated pre-normalization peak RIR levels:
| Method | Peak MAE (dB) | Room-macro MAE (dB) | Within 3 dB (%) |
|---|---|---|---|
| Philac | 2.129 | 1.755 | 77.4% |
| EigeNet | 2.796 | 2.726 | 65.6% |
| FLAC | 3.404 | 2.502 | 60.9% |
Philac achieves the lowest peak-level error and places 77.4% of predictions within 3 dB of ground truth. We have included this pre-normalization peak gain validation in Appendix C.13 (Table 19) of the revised manuscript.
Dear Reviewer TGJ2,
Thank you again for your thoughtful and constructive review, and for recognizing the meaningful problem setting, two-stage architectural decomposition, and empirical consistency of PHILAC.
As the discussion deadline approaches, we wanted to gently follow up to see if our response and revised manuscript have addressed your concerns. Specifically, we have added the matched-distance LOS-to-NLOS occlusion test (Appendix C.3, Table 8), heterogeneous context visibility and dense trajectory evaluations (Appendix C.3, Tables 9–10), the blinded ITU-R BS.1534 MUSHRA listening study with interactive audio examples (Appendix C.4, Table 11), and pre-normalization peak gain validation (Appendix C.13, Table 19).
We would welcome any further feedback and remain available to address any remaining questions during the discussion period. Thank you for your time and effort!
Best regards, The Authors
Dear Reviewer TGJ2, we kindly reach out before the discussion window closes to see if our new spatial field analyses and MUSHRA listening evaluation have addressed your concerns, and we welcome any additional feedback.
Response to Reviewer TGJ2 I (TBC)
We thank Reviewer TGJ2 for the thoughtful and constructive review, and for recognizing the motivation, architectural decomposition, and empirical consistency of Philac. Below we address each weakness (W1–W3) and question (Q1–Q4) point by point.
W1(a) & Q1: Spatial structure beyond source–receiver distance & geometry ablation clarification
To rule out the hypothesis that Philac merely scales a room-average response by source–receiver distance, we construct a controlled matched-distance occlusion test. Each pair shares the same receiver and nearly identical source–receiver distance (Δd≤0.2 m, angular separation ≥60∘), but has opposite ray-mesh visibility (one LOS and one NLOS source). We evaluate the signed parameter change from LOS to NLOS and its pairwise Mean Absolute Error (MAE) against ground truth:
From the results, we observe that Philac achieves the lowest pairwise difference MAE across all three metrics, closely matching the ground-truth mean shifts. Against the room-and-distance baseline (Blind T60 + FDN), Philac reduces room-weighted difference MAE by 1.432 dB for DRR and 1.664 dB for C50.
Clarification on Table 5 geometry ablation: In submitted Table 5, w/o visual/relative geometry masks out the panorama and relative-surface features at inference from the trained full checkpoint while retaining the geometric direct-arrival delay τq=∥q∥/c; it is not a separately retrained geometry-free model.
W1(b) & Q2: Heterogeneous context paths
We evaluate how context path composition affects prediction by holding the target queries and context budget (K=2) fixed while varying whether the context recordings come from LOS-only, NLOS-only, or mixed (1 LOS + 1 NLOS) positions. We test both unseen synthetic rooms across AcousticRooms and measured real-room RIRs from HAA:
Context composition measurably shifts predictions rather than collapsing to a single context-agnostic prior. On synthetic rooms, matching the context visibility to the target stratum yields the lowest EDC error at 3.602 dB for LOS targets and 3.659 dB for NLOS targets. On the measured HAA rooms, NLOS-only context achieves the lowest EDC error for both target strata because occluded recordings are dominated by the diffuse reverberation tail that constrains room-level EDC.
W1(c): Consistency along dense trajectories
To test spatial continuity under independent per-query generation, we evaluate fixed-receiver, fixed-context (K=8) predictions along three measured HAA trajectories:
We also evaluate 22 mesh-checked grid trajectories on AcousticRooms, where Philac outperforms FLAC on adjacent T60 change at 0.065 s versus 0.095 s and peak-gain change at 2.158 dB versus 2.599 dB. At the same time, we agree that independent per-query sampling does not by itself guarantee smooth waveform-level continuity for moving-source rendering. We have reported these measured trajectory-change statistics in Appendix C.3 (Table 10) and framed autoregressive or joint multi-query generation as a key next step in Appendix D of the revised manuscript.