- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper is motivated by the observation that existing sound source localization methods rely on audio-visual feature similarity, which only establishes category-level correspondence. The model cannot tell whether an object is actually sounding, so silent objects of the same category get localized too. Generic CoT prompting lets an MLLM reason in steps, but it does not choose the right modality for each step, and it never revisits earlier predictions with temporal context. The paper proposes STAR-AVL, a training-free structured prompting pipeline that turns video-centric audio-visual localization into four reasoning steps, and claims three contributions: the framework itself; two complementary components, one deciding which object is sounding and the other resolving the remaining localization ambiguity; and experiments on AVATAR and VGGSound-Duet against trained methods, single-step MLLMs on the same backbones, and three CoT approaches.
The presentation and soundness of is paper is OK, but my main concern is methodological. This is a routine combination of CoT and localization. The recipe of turning audio into a textual reference and then localizing the sounding object from it is already done by OpenAVS, and training-free multi-step MLLM reasoning for this task by GAR. The only new element is the temporal dimension: history conditioning and a neighboring-frame re-check, and the re-check is essentially smoothing. The experiments do not establish much beyond "multi-step prompting with temporal smoothing compensates for a weak backbone". The control that would decide the question, per-frame GAR plus simple smoothing, is missing, and the central hypothesis is never tested directly.
Critical strengths
The problem framing is reasonable. Feature similarity alone cannot tell a sounding object from a silent one of the same category, and the paper says so. This is a real reason why AVGN-style trained methods (Mo & Tian, 2023) have long underperformed on AVATAR.
The step decomposition hangs together. AA sees only audio, AVM sees audio-visual input, LOC sees vision plus history. Each step gets the modality its decision actually needs. That said, coherence is not novelty (Weakness 1).
TR is cheap. Triggering only on suspicious frames keeps latency below every CoT baseline, and Figure 7 shows two kinds of genuine fixes: box-scale corrections and recovery of missed entities.
Critical weaknesses
-
The method is a routine CoT-plus-localization combination, and a nearly identical paper exists. The core chain, turning audio into a textual reference (Step 1, audio analysis) and then localizing the sounding object from that reference (Step 2, audio-visual matching, and Step 3, localization), has direct precedents. OpenAVS [1] does the same thing with a training-free pipeline of audio-to-text prompt, LLM translation, and text-to-sounding-object segmentation, and GAR [2] applies training-free multi-step MLLM reasoning to sound source localization. Task decomposition with reflective correction is standard practice from Least-to-Most and Step-Back prompting. What is left is the temporal dimension, and it is thin: history conditioning is ordinary context conditioning, and the temporal-aware re-evaluation (Step 4) is essentially smoothing. The method section separates itself from prior work in a single sentence. So what the paper adds over these methods is small, and this is the main reason for my score.
-
The experiments do not isolate what the framework adds. GAR appears only in Table 6 on VGGSound-Duet, with cited numbers, and not at all on the main benchmark AVATAR. The obvious control for the temporal claim, running GAR per frame on AVATAR and then adding simple smoothing, was never done; if it recovers most of the gain, the framework adds little. Table 3 also confounds structure with call count, since the full pipeline takes about three times as long per frame as the single-step baseline and there is no control matched on the number of calls. The central hypothesis is never tested directly either: there is no muted or swapped audio test, no count of boxes on silent distractors, and no accuracy for the Step 1 labels or Step 2 visibility decisions. Without these controls, the results only show that multi-step prompting with temporal smoothing makes up for a weak backbone. Table 4 points the same way: the gain shrinks on the strongest backbone, and most of the headline lead comes from the backbone itself.
References
[1] Chen, Yin, Cao, Xiang, Liu & Zimmermann. OpenAVS: Training-free open-vocabulary audio visual segmentation with foundational models. ICME 2026 (arXiv:2505.01448).
[2] Park & Kim. Generate, analyze, and refine: Training-free sound source localization via MLLM meta-reasoning. CVPR 2026.
Questions for authors
- How does GAR [1] perform when run per frame on AVATAR, with and without simple temporal smoothing?
- How does the method compare with a control matched on the number of MLLM calls?
- Could you add a muted or swapped audio test, report how often boxes land on silent distractors, and give the accuracy of the Step 1 labels and Step 2 visibility decisions?
- On the cross-event subset (Table 5), STAR-AVL loses much more from Total to Cross-event than TAVLO, and its gain over its own baseline shrinks. Sound-source switching is where temporal reasoning should help most. How do you explain this?
- The AUC and CIoU columns of the MLLM rows in Table 1 are nearly identical digit for digit. How was the threshold sweep configured? Also, how are the low-resolution saliency maps of the trained methods scored against box outputs? With this format mismatch, "outperforms all audio-visual models" says very little.
- How are multi-entity matches scored, and how are empty outputs handled?
- AVATAR is described only as a test set. Were the prompts designed on it or on a held-out split? Please also report decoding configurations.
- Do the results hold on a second video-centric benchmark? All video-centric results come from AVATAR, and VGGSound-Duet is a stitched image-centric setting.
References
[1] Park & Kim. Generate, analyze, and refine: Training-free sound source localization via MLLM meta-reasoning. CVPR 2026.