- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
A dataset paper sources from youtube and instragram with life-long feline videos across multiple breeds built using a robust pipeline. There are some ethical concerns regarding the data licenses. Moreover, the evaluation has some problematic parts.
Critical strengths
This paper proposes a new dataset on cat vocalization sourced from different public videos. The main novelty of this dataset is the fact that it allows for longitudinal studies. The pipeline for the data processing looks robust with some of the steps verified by human annotators (so-called quality filters are in place).
Critical weaknesses
Classification pipeline: There are more recent animal sound encoders that may be used: perch2, avex family, birdnet, birdmae etc, although some are bird-dominated/focused they also work for non-birds as good encoders, particularly call types. AVES is already behind those other models in many benchmarks. The classification head is a GMM but linear probing, LSTM or even transformer heads may improve performance dramatically. Also it's unclear whether the last year is the best one for the task. I am also unsure about the scientific findings and the stats that were used to validate them (the entire clustering part).
Questions for authors
Has this been validated? "We eliminated any video with a confidence score of under 0.50 using the prompt “image of a cat.”" How do you account for multiple cats in the same video? How do you account for cats that don't get to live in the entire expected life-span? What is their percentage if so? Not all of these classes are vocalizations because some of the sounds are not produced by the vocal tract: "The model classifies cat vocalizations into eight broad types: chatter, growl, hiss/spit, meow, purr,pain cry, trill, and yowl/howl" ie hiss, purr It is unclear whether there is a manual test set for call types. I think it should be and not semi-automatic. I am unsure about the clustering evaluation. I think the repertoire of a cat sits on a continuum and the clusters and number of clusters also change with age and are quite subjective, maybe report clustering metrics (nmi, ari) against human annotated classes. I am unsure whether the authors use the correct statistical tests. These tests come with some assumption on data and feature correlation and they should not be used blindly (explain why you use a test parametric vs non-parametric)
We thank the reviewers for their time. We are withdrawing the paper to pursue a venue better suited to the work.