- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper constructs a novel motion-language benchmark for mice and rats, the first dataset that contains both behavior- and event-level descriptions together with kinematic information. It further trains three representative text-to-motion models on the constructed dataset using descriptions of different levels, showing the usefulness of this dataset.
Critical strengths
This is the first rodent motion-language datset to have both behavior- and event-level descriptions together with kinematic information.
Critical weaknesses
Motivation: While the paper mentions that "Mice and rats are widely used to investigate how neural activity, genetic variation, and experimental interventions relate to behavior. Posture, locomotion, exploration, and grooming reveal responses to the environment", this work does not show how this dataset can be used for related downstream tasks. Instead this work focuses on text-to-motion generation, a classical task in computer vision. This raises concerns about this paper's motivation.
Questions for authors
Could you elaborate on your motivation for this work, especially how this dataset or text-to-motion tasks can be used for relevant downstream tasks or scientific exploration? While I am not an expert, I guess this might be related to neuroscience or cognitive science.