Hearing Anywhere from Anything: Geometry-Conditioned Acoustic Field Synthesis from Unlocalized Blind Recordings
Abstract
Reconstructing a room’s acoustic field is essential for rendering spatial audio at previously unobserved source locations. Yet existing methods typically require either scene-specific optimization or carefully measured room impulse responses (RIRs) with calibrated positions. We observe that ordinary recordings in everyday life, such as speech and music, are also shaped by the room and therefore contain acoustic evidence. Exploiting this evidence is challenging because both the dry source signals and the positions of the recorded sources are unknown. Our key insight is to formulate it as a physics-anchored conditional completion problem. Unlocalized recordings reveal room-level decay and reverberation, whereas target geometry anchors direct-path timing and specifies the source–receiver path of interest. Building on this insight, we introduce PHILAC, a two-stage framework that first predicts a query-conditioned energy-decay profile and then generates the target RIR through masked discrete diffusion of acoustic codec tokens. On unseen synthetic rooms, PHILAC achieves a mean EDC error of 2.660 dB, improving over the strongest baseline by 19.5%. On real rooms, we outperform the strongest baseline by 45.7% in mean EDC error without scene-specific adaptation. These results show that everyday recordings can provide acoustic context for synthesizing RIRs at new locations without calibrated acoustic measurements.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.