Corpus ID: 174801444

Detection and Tracking of Multiple Mice Using Part Proposal Networks

  title={Detection and Tracking of Multiple Mice Using Part Proposal Networks},
  author={Zheheng Jiang and Zhihua Liu and Long Chen and Lei Tong and Xiangrong Zhang and Xiangyuan Lan and Danny Crookes and Ming-Hsuan Yang and Huiyu Zhou},
The study of mouse social behaviours has been increasingly undertaken in neuroscience research. However, automated quantification of mouse behaviours from the videos of interacting mice is still a challenging problem, where object tracking plays a key role in locating mice in their living spaces. Artificial markers are often applied for multiple mice tracking, which are intrusive and consequently interfere with the movements of mice in a dynamic environment. In this paper, we propose a novel… Expand
2 Citations
SLEAP: Multi-animal pose tracking
SLEAP (Social LEAP Estimates Animal Poses), a framework for multi-animal pose tracking via deep learning, is presented, capable of simultaneously tracking any number of animals during social interactions and across a variety of experimental conditions. Expand
Deep learning tools for the measurement of animal behavior in neuroscience
It is envisioned that the fast-paced development of new deep learning tools will rapidly change the landscape of realizable real-world neuroscience. Expand


Automatic Visual Tracking and Social Behaviour Analysis with Multiple Mice
The validity and effectiveness of this new machine learning system in the detection of social and non-social behaviours in multiple (>2) interacting mice, and its versatility to deal with different experimental settings and scenarios are demonstrated. Expand
Fast animal pose estimation using deep neural networks
This work validated LEAP using videos of freely behaving fruit flies and tracked 32 distinct points to describe the pose of the head, body, wings and legs, with an error rate of<3% of body length and demonstrated LEAP’s applicability for unsupervised behavioral classification. Expand
Automated multi-day tracking of marked mice for the analysis of social behaviour
This work presents a method for tracking group-housed mice individually as they freely interact over multiple days, enabling accurate and reproducible characterisation of wild-type mouse social behaviour and paves the way for high-throughput long-term observation of the effects of genetic, pharmacological and environmental manipulations. Expand
ArtTrack: Articulated Multi-Person Tracking in the Wild
This paper uses a model that resembles existing architectures for single-frame pose estimation but is substantially faster to generate proposals for body joint locations and forms articulated tracking as spatio-temporal grouping of such proposals. Expand
Automated long-term tracking and social behavioural phenotyping of animal colonies within a semi-natural environment.
A broadly applicable system that automatically tracks the locations of multiple, uniquely identified animals, such as mice, within a semi-natural setting and demonstrates the usefulness of these data in characterizing individual phenotypes, interactions between pairs and the collective social organization of groups. Expand
Target Identity-aware Network Flow for online multiple target tracking
It is shown that automatically detecting and tracking targets in a single framework can help resolve the ambiguities due to frequent occlusion and heavy articulation of targets. Expand
Real-Time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification
This paper proposes to handle unreliable detection by collecting candidates from outputs of both detection and tracking, and adopts a deeply learned appearance representation, which is trained on large-scale person re-identification datasets, to improve the identification ability of the tracker. Expand
Online Multi-Target Tracking Using Recurrent Neural Networks
This work proposes for the first time, an end-to-end learning approach for online multi-target tracking based on recurrent neural networks (RNNs) and shows promising results obtained at ~300 Hz on a standard CPU. Expand
Automated home-cage behavioural phenotyping of mice.
A trainable computer vision system enabling the automated analysis of complex mouse behaviours that performs on par with human scoring, as measured from ground-truth manual annotations of thousands of clips of freely behaving mice. Expand
Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning
An integrated hardware and software system that combines video tracking, depth-sensing technology, machine vision, and machine learning to automatically detect and score innate social behaviors, including aggression, mating, and social investigation, between mice in a home-cage environment is described. Expand