- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes TRAIL, a self-supervised framework for learning compact representations of short animal movement trajectories. The input is the 2D trajectory of three keypoints (nose, neck, body) obtained by DeepLabCut from top-view video at 11 Hz, together with 25 maze waypoints as context. The encoder follows Wayformer and Q-Former: coordinates receive multi-frequency encodings, eight learned queries summarise all tokens, and the first query is projected to a 16-dimensional representation. Training combines a temporal-proximity contrastive loss, in which segments of the same recording partition within 10% of its duration are positives and all others are negatives, with a Gaussian negative log-likelihood reconstruction loss. The data come from the Y-maze spatial learning experiments of Shridhar et al.: six rats learning an alternation rule and eight rats learning a probabilistic rule, five days each, 275 sessions, about 45 hours. Evaluation freezes the encoder and fits linear probes for identity, recording day, trial-level proficiency, and success rate and reward count within ±30 seconds. TRAIL is reported to outperform classical state-space models, deep behavioural representation methods, time-series foundation models and a multi-task supervised variant, and to remain competitive on the MABe22 mouse triplet benchmark.
Critical strengths
- The learning-progress half of the problem is well posed. Longitudinal recordings of the same individual across days of learning, under a quantifiable reward rule with trial-level outcomes, are hard to obtain for humans, and rodent spatial-learning experiments are an appropriate setting for asking whether movement changes with learning.
- The breadth of the evaluation and the reporting of uncertainty. Baselines span classical state-space models, deep behavioural representation methods, time-series foundation models and a supervised variant; the appendix reports animal-bootstrap confidence intervals and paired comparisons, and adds held-out-session, held-out-day and new-animal experiments.
- Translating representation-space directions back into movement is an interesting attempt. Using a diffusion model conditioned on the frozen representation with DDIM inversion to inspect what the representation encodes is a reasonable direction for hypothesis generation.
Critical weaknesses
W1. The input consists of only three keypoints, which does not constitute pose or motion in any meaningful sense; what the model learns from it is most likely trajectory and projection-induced variation rather than movement, which bears directly on whether the paper's claim can be substantiated. (a) Sec. 4 states that only the nose, neck and body keypoints are used because they are "the most reliably tracked using DeepLabCut". For a mammal, movement is defined by limb articulation, and the three points contain no limb information at all. Nevertheless, the abstract and introduction repeatedly refer to "fine-scale posture", "limb posture" and "egocentric pose dynamics", none of which is present in the data. (b) More fundamentally, nose, neck and body correspond in three dimensions to a single joint, the neck, whose range of motion is itself limited. The true body configuration should therefore be very similar across the great majority of frames, and the variation in what the paper calls "local pose" arises mainly from projection under a single fixed camera: the animal's position in the field of view and the pitch and roll of its head relative to the camera change the projected lengths and angle of the two segments, and none of this is articulation. In other words, most of the learnable variation in the Local Pose view is projection geometry and tracking noise rather than movement. Given that the Global Trajectory view, which contains only position and heading, already reaches 72.1% identity accuracy (Table 3), the more plausible reading is that the model learns identity and day from where the animal is, where it is going and how its head is tilted relative to the camera, not from how it moves. The paper's central claim is that short-term movement reveals identity and learning progress; on the present data this cannot be distinguished from the claim that trajectory and projection-induced variation reveal them. (c) The model itself is not restricted to three keypoints, so this is a choice of data rather than a limitation of the method. Data of this kind can serve as an auxiliary evaluation but cannot be the sole basis for the central claim. The authors should redo the main experiments on recordings with limb tracking and quantify how much of the local-pose variation is explained by position in the field of view and head pitch; otherwise the claims and terminology should be restricted to short-term trajectories of the head and trunk.
W2. The identity question neither requires nor is well served by a study on six rats. Learning progress calls for longitudinal animal data (see S1), but whether short movement reveals individual identity does not: human motion data offer several established identity benchmarks with many individuals and full-body pose, for example the BOXRR-23 corpus of VR head and hand motion from over 100,000 users, the public gait-recognition datasets, and the recent BALLER120 benchmark built around individual differences in a single repeated action. The identity conclusion here rests on a single cohort of six rats, a six-way classification, three keypoints and one maze. A "movement fingerprint" established under these conditions does not generalise, yet the title and abstract state it in general terms. The authors should validate the identity half on at least one human motion dataset, or explicitly scope the claim to rats in a Y-maze.
W3. The main evaluation task is defined by the authors, and the method is a combination of existing components without a new mechanism. On the evaluation side, the five readouts, the protocol and the split are the authors' own design on a single laboratory's dataset; the only external benchmark is MABe22, where TRAIL is merely competitive and weaker than hBehaveMAE on frame-level tasks. On the method side, the components of TRAIL all come from existing work: Wayformer-style alignment and multi-frequency encoding, the Q-Former of BLIP-2, an InfoNCE contrastive loss, Gaussian reconstruction, and DiT with DDIM inversion. Overall the method reads as an engineering combination of these parts, without a particular insight or novelty, and without a design targeted at the identity or learning-progress question. The idea the paper presents as its core hypothesis, that temporally nearby segments should be positives, also has close counterparts in self-supervised time-series learning.
Questions for authors
- Is there an animal pose dataset with more than three keypoints, including the limbs, on which the main experiments of this paper could be repeated? If no such data currently exist, could the authors add manual limb annotations to the existing recordings? Three keypoints are not sufficient to support the paper's conclusions about movement.
- How much of the variation in the Local Pose view is explained by the animal's position in the field of view and the pitch of its head relative to the camera, for example by regressing the projected segment lengths and angle on position? How much identity accuracy does Local Pose retain once this component is removed?
- One of the paper's conclusions is that short-term movement trajectories reveal individual identity. Can this conclusion be verified on a human motion dataset? Specifically, could the authors report identity recognition accuracy on a human dataset with subject identity labels, full-body keypoints and far more than six individuals? To my knowledge such datasets are readily available, for example motion-capture datasets with subject identifiers, gait-recognition datasets and large-scale VR motion corpora.
3 comments
Response to Reviewer nQbw (2/2)
W3. Scientific contribution, external evaluation, and methodological design
Scientific objective and evaluation. Through the main spatial-learning dataset, our central question is whether short movement trajectories carry information about individual identity and learning progress, and how that information appears in behavior. The five downstream tasks provide measurable proxies for these concepts. We use them to evaluate the representation in Section 4, after TRAIL learns from trajectories without predefined behavioral features or downstream labels. Section 5 then uses the representation to examine when and where these signals are strongest and how different movement views contribute.
Methodological design and novelty. We agree that TRAIL builds on established components. Our contribution lies in adapting and evaluating these components to answer specific questions about individual identity and learning-related behavior, rather than just combining established components for beating baselines. We adapt trajectory modeling from autonomous driving to learn behavioral representations and use multi-frequency encoding to capture subtle changes in keypoint coordinates over time. The temporal contrastive objective encourages nearby trajectories to have similar representations because they may share behavioral characteristics, while reconstruction encourages the representation to retain movement detail in the representation. Together, these choices let TRAIL capture information about identity and learning without task-specific supervision. Appendix C (p. 23) examines the design choices through ablations, and Section 5 shows how different movement views carry complementary information and how these signals vary across temporal and spatial contexts.
Performance on MABe22 dataset. Alongside the spatial-learning dataset, we evaluate TRAIL on the established MABe22 Mouse Triplets benchmark, which records three mice interacting in an open arena. This complementary setting lets us compare TRAIL with existing methods beyond the spatial-learning experiments. TRAIL performs well on within-clip identity and sequence-level tasks, while hBehaveMAE performs better on frame-level tasks. Frame-level tasks require precise localization of brief interactions in time, whereas TRAIL summarizes short movement windows to capture individual characteristics and movement variation associated with longer-term behavioral change. These results clarify the kinds of behavioral information TRAIL captures and the tasks for which its representation is best suited.
Question 1. Richer pose data and limb annotation.
Please refer to our response to W1(a) and (c).
Question 2. Position and projection effects on Local Pose.
Please refer to our response to W1(b).
Question 3. Identity validation on human motion data.
Please refer to our response to W2.
Ethics concern — Animal-use approval
Thank you for highlighting this omission. Our study reuses the published data from Shridhar et al. [1] and involves no new animal experiments. We will add an ethics statement citing the original study’s animal-use approval.
[1] Shridhar et al., “Goal Location Beta Oscillations and Sharp Wave–Ripples Are Complementary Markers of Learning-Related Changes in Hippocampal–Neocortical Networks,” eNeuro, 2026
Thank you again for your valuable feedback, which has helped us improve the manuscript. We welcome any remaining questions and would appreciate your reconsideration of the score if our responses have addressed your concerns.
Remaining concern: the choice of dataset and the reliability of the tracked keypoints
Thank you for the response and for the additional Plus-maze results.
My main concern remains the choice of dataset in the experiments, for two reasons.
First, I am not convinced that a dataset with three keypoints (nose, neck and body) and a primary cohort of six rats is sufficient to support the claim that short-term movement reveals individual identity and learning progress.
Second, the response states that "the three reliably tracked keypoints are sufficient to detect identity and learning-related information in this task". However, the keypoints are obtained with DeepLabCut, which is a markerless pose estimation tool. Since DeepLabCut trains a network on a small set of manually labelled frames, almost all keypoint coordinates used in the paper are network predictions and not manual labels. On what basis are the three keypoints considered "reliably tracked"? The paper gives no criterion for this, such as a likelihood threshold, no tracking error with respect to manual labels, and no fraction of removed frames. Predicted coordinates carry prediction errors. How do these errors affect the results? In particular, the nose-neck and neck-body segments are short, so the tracking error may account for a considerable part of the variation in the Local Pose view. In addition, a tracking error that differs systematically between animals could itself contribute to the Identity accuracy.
Response to Reviewer nQbw (1/2)
We thank Reviewer nQbw for their feedback. Our study uses short movement trajectories to investigate individual differences and changes during spatial learning. We address your concerns below.
W1. Movement information captured by three keypoints
We agree that three keypoints provide limited coverage of limb articulation, and we respectfully disagree that this makes them insufficient for studying movement. The nose, neck, and body keypoints capture how each rat moves through the maze and how its head and trunk move relative to each other. Both are relevant to our question of how short movements relate to identity and learning across days.
(a) Relevance to spatial navigation. The tracked keypoints capture navigation and brief head and neck movements during behaviors such as scanning and stalling. We would also want to clarify some misunderstanding. While “limb posture” is mentioned in the introduction in the context of discussing prior motor-learning studies, “fine-scale posture” and “egocentric pose dynamics” refer to subtle changes in the tracked head–neck–body dynamics, which we analyze in Section 5 and Table 3.
(b) Camera setup and movement decomposition. The spatial-learning dataset uses a fixed overhead camera that covers the entire maze across rats and recording days, with calibration to minimize distortion [1]. From each Full Movement trajectory, we derive Local Pose by normalizing position and heading to capture changes in relative body configuration. Global Trajectory retains changes in position and heading and omits relative body configuration. The 72.1% identity accuracy for Global Trajectory shows that navigation patterns carry identity information. Local Pose reaches 77.1%, and Full Movement reaches 84.0% (Table 3), indicating that navigation and relative head–trunk movement carry complementary information about identity.
(c) Dataset suitability and additional annotations. The three reliably tracked keypoints are sufficient to detect identity and learning-related information in this task. Limb tracking would add detail about gait and articulation, while the available keypoints already capture the navigation measures central to our question, including where rats go, how they turn, and how they scan. We will clarify that our conclusions concern the movements captured by these three keypoints.
W2. Cohort size and scope of the identity findings
We appreciate the reviewer’s concern about the scope of the six-rat identity experiment. Our question is whether short movement sequences distinguish individual rats as their behavior varies across days of controlled spatial learning. Repeated recordings let us examine this variation within the same animals, and the three keypoints capture the relevant navigation and head–trunk movements (W1). A large human motion benchmark would test identity recognition in a different population. The longitudinal rodent recordings directly address our question about individuality during spatial learning.
Our evidence extends beyond the original six-rat cohort. Appendix B.1 reports similar performance in eight additional rats learning a different reward rule in the Y-maze. As detailed in our general response, we also evaluated six additional rats recorded over five days in a four-arm Plus-maze. These results broaden the evidence across cohorts, reward rules, and maze geometries. We will clarify that our identity findings apply to the rodent settings evaluated in this study.