- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents TraSNav, an embodied navigation method for the indoor audio-visual navigation task, where the target sound is brief, intermittent, and interfered with by other sounds. The agent utilizes the RGB-D observations, acoustic cues, and historical information to find the target sounding objects. To acquire a more reliable target representation, this paper proposes RTEM and TSAMF, which successfully improve the navigation performance in scenes where the target sound events are brief.
Critical strengths
- The evaluation protocol controls key variables well. The authors progressively shorten the target sound event to 90% - 10% of the original duration while preserving the event onset times, event counts, and the configurations of the interfering sound events.
- TraSNav outperforms other baseline methods in SR and SPL across multiple conditions, including the original settings and shortened scenarios.
- The authors provide ablation studies and analysis of training stability and module behavior.
Critical weaknesses
- Insufficient support for the claimed reliability improvement of RTEM. RTEM is used to improve the target-event representation's reliability. However, from the ablation studies in the main paper, the performance gain from RTEM alone is minimal. It is recommended that the author provide more direct evidence of the advantage of RTEM, such as the sound event detection accuracy and the sound event localization accuracy with and without the proposed RTEM.
- The contribution of the temporal-scope modulation factors is not isolated. In Equation 9 of the main paper, the authors use , a factor that decreases with the progress of navigation, thereby progressively reducing the influence of sound-event information in constructing the current scene memory. However, the current ablation experiments do not isolate the contribution of this factor. It is recommended that the author provide ablation experiments for this factor in different settings, such as a no-decay consistent factor.
- The authors only conduct experiments on multi-source scenarios. It is recommended that the authors provide more experiments on single-source scenarios and noisy scenarios to confirm the capabilities of the proposed RTEM and TSAMF in terms of target-sound information acquisition and noise resistance.
- Figure S1 shows that the interfering sound event remains active throughout the navigation process. However, in the multi-sound scenarios, the interfering sound event is also intermittently active. The authors also state that the interfering sound is active for about 44.11% of the navigation process. It is recommended that the authors clarify this ambiguity.
Questions for authors
- Could the authors provide direct evidence of the improved reliability of the target sound representations?
- Could the authors provide ablation studies of the scaling factor in TSAMF?
- Could the authors provide experiments on single-source and noisy scenarios?
8 comments
Response to Critical Weakness 4
We thank you for pointing out the potential ambiguity in the presentation of interfering-sound activity in Figure S1. We have further examined the interfering-sound schedules and the corresponding statistics of the original episodes.
In the actual multi-source test scenarios, interfering sounds are not continuously active throughout the navigation process. Instead, they occur intermittently according to predefined temporal schedules. According to the statistics of the original test set, interfering sounds are active for an average of 44.11% of the navigation duration, while the remaining 55.89% of the time corresponds to inactive periods.
The interfering-sound bar in the original Figure S1(b) was primarily intended to illustrate the experimental control principle that the interfering-sound schedule remains unchanged across different target-sound duration conditions, rather than to precisely represent its actual active intervals throughout the timeline. We acknowledge that the current illustration may lead readers to interpret the interfering sound as being continuously active.
To eliminate this ambiguity, we will revise Figure S1(b) in the revised manuscript to explicitly illustrate the intermittent active intervals according to the actual interfering-sound schedules. We will also clarify that the interfering-sound schedule remains unchanged across all target-sound duration conditions.
Q1. Could you provide direct evidence of the improved reliability of the target-sound representations?
We thank you for the suggestion regarding the reliability of target-event representations in RTEM. We agree that it is necessary to provide evidence beyond downstream navigation performance to demonstrate how RTEM improves target-event representations by integrating acoustic evidence from different sources.
We further analyze the role of RTEM from four aspects: actual evidence retrieval behaviors, ablation studies of different evidence branches, the individual contribution of conflict projection calibration, and multi-seed training stability.
First, Figure S2 in the supplementary material analyzes the actual retrieval behaviors of RTEM from spatial, temporal, and cross-episode perspectives. Figure S2(a) shows the spatial retrieval distributions of the Support and Conflict branches within the same representative episode. Figure S2(b) illustrates the attention distributions of the two branches across historical time steps, together with the activity intervals of target and interfering sounds. Figure S2(c) further reports cross-episode attention enrichment statistics over 100 test episodes. The results show that the Support branch exhibits stronger attention enrichment over target-sound-active history, whereas the Conflict branch exhibits corresponding attention enrichment over interfering-sound-active history. These results provide evidence from actual retrieval behaviors supporting the functional division of the two evidence branches, indicating that RTEM can retrieve supporting information and potential conflicting information relevant to target events from historical memory.
Second, the original Table 5 analyzes the contributions of different evidence sources to target-event representations by progressively introducing the Candidate, Support, and Conflict branches. The results show that introducing either recent supporting evidence or historical conflicting evidence on top of Candidate-only brings positive improvements in navigation performance, while the complete RTEM achieves better overall results by jointly utilizing these two complementary sources of evidence.
To distinguish the contributions of conflict-evidence retrieval and conflict projection calibration, we introduce an additional ablation variant, Full RTEM w/o Projection Calibration. In this setting, target-candidate retrieval, recent supporting-evidence retrieval, historical conflicting-evidence retrieval, and the subsequent negative-conflict fusion are all retained, while only the projection calibration operation in Eq. (5) is removed.
Table R1. Ablation of conflict projection calibration under different target-sound conditions (SR, %).
| Variant | Original | 80% | 50% | 20% |
|---|---|---|---|---|
| Full RTEM w/o Projection | 46.19 | 42.46 | 34.89 | 19.71 |
| Full RTEM | 46.28 | 42.58 | 35.22 | 19.98 |
As can be observed, the complete RTEM improves SR by 0.09, 0.12, 0.33, and 0.27 percentage points under the four test conditions, respectively. This indicates that conflict projection calibration further suppresses components of the target representation that align with the conflicting-evidence direction, building upon the retained conflict-evidence retrieval, and provides a positive contribution to downstream navigation performance.
Finally, to further investigate whether the performance gains brought by RTEM are affected by training randomness, we conducted three independent training runs of the RTEM-only variant and compared the results with the three independent training runs of the complete TraSNav model previously reported in Supplementary Table S4.
Table R2. Multi-seed stability analysis of RTEM-only and full TraSNav (SR, %).
| Variant | Original | 80% | 50% | 20% |
|---|---|---|---|---|
| Baseline | 45.96 | 41.77 | 33.30 | 18.67 |
| RTEM-only | 46.31±0.16 | 42.62±0.18 | 35.21±0.22 | 20.08±0.25 |
| Full TraSNav | 48.96±0.14 | 45.22±0.16 | 38.37±0.24 | 23.49±0.23 |
The results show that the standard deviations of SR for RTEM-only do not exceed 0.25 percentage points across the four target-sound duration conditions, which is comparable to the training variation of the complete TraSNav model, indicating good training stability across different random seeds. Further comparison shows that the mean SR of RTEM-only is higher than that of the original Baseline under all four test conditions, with improvements of 0.35, 0.85, 1.91, and 1.41 percentage points, respectively, demonstrating a consistently positive performance trend.
We sincerely thank you for your careful evaluation of our work and your positive assessment of our experimental controls, navigation performance improvements, and ablation analyses. We particularly appreciate your recognition of our controlled evaluation protocol under different target-sound duration conditions and the performance improvements achieved by TraSNav under brief target-sound conditions.
In response to the four major concerns you raised, we have conducted additional experiments and analyses to provide a more comprehensive evaluation of the proposed method. Specifically, regarding the reliability of target-event representations in RTEM, we further investigate the roles and stability of its individual components through actual attention retrieval behaviors, evidence-branch ablations, conflict projection calibration ablations, and multi-seed experiments. To examine the contribution of the temporal-scope modulation factor in TSAMF, we introduce a test-time ablation that retains the learned event gate while fixing the temporal decay factor. For single-source and noisy environments, we conduct additional evaluations using the existing model checkpoints to examine the performance of our method under different acoustic conditions. Furthermore, we have re-examined the actual activity schedules of interfering sounds and will further revise Figure S1 to accurately illustrate their intermittent activity patterns.
We hope that these additional experiments and analyses provide further insights into the design rationale of RTEM and TSAMF, the contributions of their individual components, and the applicability of TraSNav under different acoustic environments.