Unknown

Dataset Information

0

Fast animal pose estimation using deep neural networks.


ABSTRACT: The need for automated and efficient systems for tracking full animal pose has increased with the complexity of behavioral data and analyses. Here we introduce LEAP (LEAP estimates animal pose), a deep-learning-based method for predicting the positions of animal body parts. This framework consists of a graphical interface for labeling of body parts and training the network. LEAP offers fast prediction on new data, and training with as few as 100 frames results in 95% of peak performance. We validated LEAP using videos of freely behaving fruit flies and tracked 32 distinct points to describe the pose of the head, body, wings and legs, with an error rate of?<3% of body length. We recapitulated reported findings on insect gait dynamics and demonstrated LEAP's applicability for unsupervised behavioral classification. Finally, we extended the method to more challenging imaging situations and videos of freely moving mice.

SUBMITTER: Pereira TD 

PROVIDER: S-EPMC6899221 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

altmetric image

Publications

Fast animal pose estimation using deep neural networks.

Pereira Talmo D TD   Aldarondo Diego E DE   Willmore Lindsay L   Kislin Mikhail M   Wang Samuel S-H SS   Murthy Mala M   Shaevitz Joshua W JW  

Nature methods 20181220 1


The need for automated and efficient systems for tracking full animal pose has increased with the complexity of behavioral data and analyses. Here we introduce LEAP (LEAP estimates animal pose), a deep-learning-based method for predicting the positions of animal body parts. This framework consists of a graphical interface for labeling of body parts and training the network. LEAP offers fast prediction on new data, and training with as few as 100 frames results in 95% of peak performance. We vali  ...[more]

Similar Datasets

| S-EPMC6897514 | biostudies-literature
| S-EPMC8054014 | biostudies-literature
| S-EPMC8194069 | biostudies-literature
| S-EPMC6051486 | biostudies-other
| S-EPMC8248438 | biostudies-literature
| S-EPMC7085555 | biostudies-literature
| S-EPMC8796662 | biostudies-literature
| S-EPMC8560090 | biostudies-literature
| S-EPMC6010233 | biostudies-other
| S-EPMC6263766 | biostudies-literature