- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LOOM, a lightweight framework for egocentric audio-visual near-body intrusion anticipation. The method combines visual motion statistics, a CNN-GRU audio model, probability fusion, and a stateful warning mechanism. The authors also introduce ReactionGap, a simulated dataset containing 150 episodes with 3,900 prediction queries. Experiments show that LOOM achieves competitive prediction performance with low inference latency.
Critical strengths
- The paper addresses a meaningful problem in wearable assistance. It focuses on anticipating future intrusion and generating timely warnings. The evaluation of warning lead time and false alarm burden is particularly useful.
- The paper is generally well organized, and the motivation and overall pipeline are clearly presented. The experiments include several baselines, ablation studies, and statistical analyses. The reported inference latency of 8.8 ms also demonstrates the efficiency of the proposed framework.
Critical weaknesses
- The contribution of audio-visual fusion is not sufficiently demonstrated. In Table 1, LOOM only slightly improves pooled AP over the vision-only baseline (0.5438 vs. 0.5234), and the confidence interval reported in Sec. 4.2 includes zero. Moreover, the vision-only model achieves higher time-matched AUC (0.7793 vs. 0.7257, Table 1) and conditional AUC (0.7526 vs. 0.6921, Table 13). Although the authors acknowledge these limitations, it remains unclear under what conditions audio provides useful complementary information. I would like to see more direct evidence supporting the contribution of the audio branch.
- The dataset is relatively simplified. As shown in Appendix Fig. 2, the scenes contain low-detail object models and largely textureless backgrounds, which may make approaching objects easier to distinguish than in real-world scenarios. Besides, all episodes use stationary cameras, while the proposed visual features rely heavily on frame differences and expansion statistics. It is unclear whether the model can handle ego-motion, complex backgrounds, or multiple moving objects. I am concerned that the reported performance may partly depend on these simplified simulation conditions.
- There may be some dataset-specific biases. As discussed in the appendix, the two subsets use different rendering and audio generation pipelines and have different positive sample ratios. Although the authors provide conditional-AUC analysis, it is still unclear how much these differences affect the reported performance.
- Some experimental comparisons could be strengthened. The paper lacks direct comparisons with simple task-specific methods based on visual looming or time-to-contact estimation. Besides, the warning evaluation only reports selected operating points, making it difficult to compare different methods under the same false alarm burden.
Questions for authors
- Since all episodes use stationary cameras, how well would LOOM handle ego-motion such as walking or head movements? Could the authors provide additional analysis or controlled experiments to clarify the robustness of the proposed visual features under camera motion?
- Under what conditions does audio actually improve intrusion prediction? Could the authors provide some quantitative analysis or failure cases comparing LOOM with the vision-only model?
- Could the authors further explain how the differences between the two data generation pipelines affect the results, particularly the audio-visual fusion performance?
- Could the authors provide warning recall versus alarm burden curves for LOOM and the vision-only baseline? Does LOOM still perform better under the same alarm burden?