- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work addresses the problem that long-tailed audio methods measure class size by counting clips, which can be misleading because a labeled sound may fill only a small part of a clip or repeat the same content multiple times. The authors propose a small network that scores each time slice of a clip: keep as few slices as possible while still getting the correct prediction. A slowly updated copy of the model decides which clips to use. While the idea is nice and intuitive, the reported gains are small and reported only for a single seed.
Critical strengths
The motivation is clear, with an easy-to-adapt solution requiring only a change to the class weights and the addition of a small head. The extra head should not hurt performance. No extra cost at test time, and the training overhead is provided.
Critical weaknesses
All results come from a single seed, while the gains over the best baseline are close to typical variation. Please report mean with std over e.g., 3 random seeds.
Clips rejected by the teacher contribute zero to v_c. As shown in Fig. 4, since the teacher accepts about 90% of Many-class clips but only about 67% of Few-class clips, hard classes get a lower v_c and therefore a higher weight, independent of their temporal content. Therefore, a method may, to some degree, act as difficulty-based reweighting. I would appreciate adding a control where all temporal weights are set to 1, so that v_c only counts accepted clips.
The ablation in Table 3 shows that count-based weights alone already match the best baseline. Please include the count-only variant in the main tables to see how much the temporal idea adds.
Table 3 removes one piece of CETE at a time to show which pieces matter, but only on BirdCLEF. I would appreciate adding one more dataset.
Take an audio clip, e.g., with one bird call, and a copy where the same call is looped five times. The theory implies that entirely repeated content adds no effective evidence. Does CETE give both clips the same contribution, or more to the looped one? I would love to see an additional analysis of v_c / n_c vs. the repetition ratio.
Minor: please consider adding "audio" to the title to make it more informative, as the method and all experiments are audio-only.
Questions for authors
Why a linear formula ? Is tuned per dataset or shared? Why does it equal ?
Is it really temporal? The head looks at one slice at a time, and the classifier averages all slices, and an average does not care about order. So, as I understand it, given the encoder output, CETE treats a clip as a bag of slices. If the encoder's slices were shuffled before the head and pooling, would CETE's weights and statistics change?
How does CETE treat classes defined by context or acoustic scene (e.g., street, crowd, rain), where the content is the background rather than a foreground event?
Is "w/o Temporal" still training the temporal head and teacher, or are they removed?
Which dataset was used in Fig. 4?
Thank you for your time and effort in reviewing our paper. Your initial review provided valuable suggestions for improving our work. We posted our point-by-point rebuttal on November 13, providing additional theoretical analysis and experiments on the connection between temporal mass and covariance-based effective evidence, the contribution of temporal weighting beyond teacher acceptance, and the response of temporal weights to increasing sound repetition.
We would appreciate it if you could take a look at our rebuttal and share your assessment of whether the additional evidence addresses the concerns raised in your review. We would be happy to clarify any remaining questions during the discussion period. Thank you again for your time and consideration.