A self-supervised representation learning framework built on a simple hypothesis: behavioral characteristics associated with identity and learning remain relatively stable over nearby time intervals, which establishes short-term movement as an informative behavioral"fingerprint" for studying learning and individual differences.
Abstract
How learning progresses over time and varies across individuals is a longstanding question in cognitive and behavioral science. However, a major challenge is identifying observable behavioral measures that faithfully capture learning progression. Existing approaches commonly rely on predefined behavioral features or task-level performance, while fine-scale posture and movement in freely behaving animals remain less explored. In this paper, we ask: can short-term movement trajectories reveal learning progress and individual identity? We introduce a self-supervised representation learning framework built on a simple hypothesis: behavioral characteristics associated with identity and learning remain relatively stable over nearby time intervals. Using temporal proximity as supervision, our framework learns compact representations directly from movement trajectories without manually defining behavioral states or kinematic features. Using behavior data from freely behaving rats, we show that the learned representations not only improve prediction of identity and learning-related readouts over existing methods, but also provide a tool for investigating broader scientific questions about when and how these signals appear in behavior. Specifically, trajectories as short as one second contain informative learning and identity signals. Egocentric pose dynamics are more predictive of identity, whereas allocentric motion is more predictive of learning-related variation, and both signals are strongest at decision junctions in the alternation cohort. We further use a representation-conditioned diffusion model to inspect movement patterns associated with identity and learning progress. Our findings establish short-term movement as an informative behavioral"fingerprint"for studying learning and individual differences. Our code is available at https://github.com/pizhn/TRAIL.
Understanding how the brain supports flexible, goal-directed behavior is a central aim of neuroscience. Yet such behavior is highly variable and unfolds over long timescales, making it challenging to understand its organization. Advances in behavioral tracking quantify movements but do not reveal the objectives that gu...
Aditi Jha, Keyue Sky Shi, Kara A. Fulton et al.· bioRxiv· 0 citations
Early-life social experiences with parents and littermates are critical for the development of social behavior and cognition in social species. Yet, how naturalistic social interactions evolve across development remains poorly understood, because reliable tracking of multiple freely interacting animals is challenged by...
Sunjin Kim, Yejin Jeong, Hein Lin Thant et al.· bioRxiv· 0 citations
Animal behavior exhibits remarkable diversity across spatial and temporal scales, showing both significant regularity and high variability. Understanding such multiscale dynamics is essential for revealing the mechanisms and organizing principles that generate behavior and shape motor control. However, conventional ana...
Chang-Hong Han, Yu-Chen Gong, Le Sun et al.· Chaos· 0 citations
High-resolution, automated or semi-automated behavioral phenotyping of rodents is increasingly used in neuroscience to reveal behavioral characteristics, that are unreachable with standard manual methods. In fact, these computational approaches have become so remarkable in recent years, it is possible now to extract...
B. Zglinicki· Frontiers in Molecular Neuro...· 0 citations
A self-supervised framework that learns visual representations of interaction dynamics directly from paired videos of two people interacting, suggesting that diverse behavioral markers of engagement share a common foundation in interaction dynamics, and that this foundation can be learned without engagement-specific su...
Naga Venkata Sai Raviteja Chappa, L. Yankowitz, Gokul M. Nair et al.· Proceedings of the 28th Inte...· 0 citations
Affective flexibility–the capacity to flexibly process emotional information–has been assessed with affective task switching, in which response times consistently reveal larger behavioral costs when switching to the affective task. These traditional metrics of task behavior, however, discard the sub-trial dynamics that...
Jin-Yung Hong, Elliot M. Nester, Lekha Varisa et al.· bioRxiv· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduSep 29, 2026
Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.