Leg-tracking and automated behavioural classification in Drosophila.
Ontology highlight
ABSTRACT:
SUBMITTER: Kain J
PROVIDER: S-EPMC3674277 | biostudies-literature | 2013
REPOSITORIES: biostudies-literature
Publications
Leg-tracking and automated behavioural classification in Drosophila.
Kain Jamey J Stokes Chris C Gaudry Quentin Q Song Xiangzhi X Foley James J Wilson Rachel R de Bivort Benjamin B
Nature communications 20130101
Much remains unknown about how the nervous system of an animal generates behaviour, and even less is known about the evolution of behaviour. How does evolution alter existing behaviours or invent novel ones? Progress in computational techniques and equipment will allow these broad, complex questions to be explored in great detail. Here we present a method for tracking each leg of a fruit fly behaving spontaneously upon a trackball, in real time. Legs were tracked with infrared-fluorescent dyes i ...[more]
Similar Datasets
Project description:Some neurodegenerative diseases, like Parkinsons Disease (PD) and Spinocerebellar ataxia 3 (SCA3), are associated with distinct, altered gait and tremor movements that are reflective of the underlying disease etiology. Drosophila melanogaster models of neurodegeneration have illuminated our understanding of the molecular mechanisms of disease. However, it is unknown whether specific gait and tremor dysfunctions also occur in fly disease mutants. To answer this question, we developed a machine-learning image-analysis program, Feature Learning-based LImb segmentation and Tracking (FLLIT), that automatically tracks leg claw positions of freely moving flies recorded on high-speed video, producing a series of gait measurements. Notably, unlike other machine-learning methods, FLLIT generates its own training sets and does not require user-annotated images for learning. Using FLLIT, we carried out high-throughput and high-resolution analysis of gait and tremor features in Drosophila neurodegeneration mutants for the first time. We found that fly models of PD and SCA3 exhibited markedly different walking gait and tremor signatures, which recapitulated characteristics of the respective human diseases. Selective expression of mutant SCA3 in dopaminergic neurons led to a gait signature that more closely resembled those of PD flies. This suggests that the behavioral phenotype depends on the neurons affected rather than the specific nature of the mutation. Different mutations produced tremors in distinct leg pairs, indicating that different motor circuits were affected. Using this approach, fly models can be used to dissect the neurogenetic mechanisms that underlie movement disorders.
| S-EPMC6619818 | biostudies-literature
Project description:Since animals express their internal state through behaviour, changes in said behaviour may be used to detect early signs of problems, such as in animal health. Continuous observation of livestock by farm staff is impractical in a commercial setting to the degree required to detect behavioural changes relevant for early intervention. An automated monitoring system is developed; it automatically tracks pig movement with depth video cameras, and automatically measures standing, feeding, drinking, and locomotor activities from 3D trajectories. Predictions of standing, feeding, and drinking were validated, but not locomotor activities. An artificial, disruptive challenge; i.e., introduction of a novel object, is used to cause reproducible behavioural changes to enable development of a system to detect the changes automatically. Validation of the automated monitoring system with the controlled challenge study provides a reproducible framework for further development of robust early warning systems for pigs. The automated system is practical in commercial settings because it provides continuous monitoring of multiple behaviours, with metrics of behaviours that may be considered more intuitive and have diagnostic validity. The method has the potential to transform how livestock are monitored, directly impact their health and welfare, and address issues in livestock farming, such as antimicrobial use.
| S-EPMC5730557 | biostudies-other
Project description:Air pollution epidemiological studies are increasingly using global positioning system (GPS) to collect time-location data because they offer continuous tracking, high temporal resolution, and minimum reporting burden for participants. However, substantial uncertainties in the processing and classifying of raw GPS data create challenges for reliably characterizing time activity patterns. We developed and evaluated models to classify people's major time activity patterns from continuous GPS tracking data.We developed and evaluated two automated models to classify major time activity patterns (i.e., indoor, outdoor static, outdoor walking, and in-vehicle travel) based on GPS time activity data collected under free living conditions for 47 participants (N = 131 person-days) from the Harbor Communities Time Location Study (HCTLS) in 2008 and supplemental GPS data collected from three UC-Irvine research staff (N = 21 person-days) in 2010. Time activity patterns used for model development were manually classified by research staff using information from participant GPS recordings, activity logs, and follow-up interviews. We evaluated two models: (a) a rule-based model that developed user-defined rules based on time, speed, and spatial location, and (b) a random forest decision tree model.Indoor, outdoor static, outdoor walking and in-vehicle travel activities accounted for 82.7%, 6.1%, 3.2% and 7.2% of manually-classified time activities in the HCTLS dataset, respectively. The rule-based model classified indoor and in-vehicle travel periods reasonably well (Indoor: sensitivity > 91%, specificity > 80%, and precision > 96%; in-vehicle travel: sensitivity > 71%, specificity > 99%, and precision > 88%), but the performance was moderate for outdoor static and outdoor walking predictions. No striking differences in performance were observed between the rule-based and the random forest models. The random forest model was fast and easy to execute, but was likely less robust than the rule-based model under the condition of biased or poor quality training data.Our models can successfully identify indoor and in-vehicle travel points from the raw GPS data, but challenges remain in developing models to distinguish outdoor static points and walking. Accurate training data are essential in developing reliable models in classifying time-activity patterns.
| S-EPMC3256108 | biostudies-literature
Project description:Understanding the biological underpinnings of movement and action requires the development of tools for quantitative measurements of animal behavior. Drosophila melanogaster provides an ideal model for developing such tools: the fly has unparalleled genetic accessibility and depends on a relatively compact nervous system to generate sophisticated limbed behaviors including walking, reaching, grooming, courtship, and boxing. Here we describe a method that uses active contours to semi-automatically track body and leg segments from video image sequences of unmarked, freely behaving D. melanogaster. We show that this approach yields a more than 6-fold reduction in user intervention when compared with fully manual annotation and can be used to annotate videos with low spatial or temporal resolution for a variety of locomotor and grooming behaviors. FlyLimbTracker, the software implementation of this method, is open-source and our approach is generalizable. This opens up the possibility of tracking leg movements in other species by modifications of underlying active contour models.
| S-EPMC5409058 | biostudies-literature
Project description:The automated quantification of the behaviour of freely moving animals is increasingly needed in applied ethology. State-of-the-art approaches often require tags to identify animals, high computational power for data collection and processing, and are sensitive to environmental conditions, which limits their large-scale utilization, for instance in genetic selection programs of animal breeding. Here we introduce a new automated tracking system based on millimetre-wave radars for real time robust and high precision monitoring of untagged animals. In contrast to conventional video tracking systems, radar tracking requires low processing power, is independent on light variations and has more accurate estimations of animal positions due to a lower misdetection rate. To validate our approach, we monitored the movements of 58 sheep in a standard indoor behavioural test used for assessing social motivation. We derived new estimators from the radar data that can be used to improve the behavioural phenotyping of the sheep. We then showed how radars can be used for movement tracking at larger spatial scales, in the field, by adjusting operating frequency and radiated electromagnetic power. Millimetre-wave radars thus hold considerable promises precision farming through high-throughput recording of the behaviour of untagged animals in different types of environments.
| S-EPMC8662461 | biostudies-literature
Project description:PurposeTo evaluate the performance of machine learning algorithms on organ-level classification of semistructured pathology reports, to incorporate surgical pathology monitoring into an automated imaging recommendation follow-up engine.Materials and methodsThis retrospective study included 2013 pathology reports from patients who underwent abdominal imaging at a large tertiary care center between 2012 and 2018. The reports were labeled by two annotators as relevant to four abdominal organs: liver, kidneys, pancreas and/or adrenal glands, or none. Automated classification methods were compared: simple string matching, random forests, extreme gradient boosting, support vector machines, and two neural network architectures-convolutional neural networks and long short-term memory networks. Three methods from the literature were used to provide interpretability and qualitative validation of the learned network features.ResultsThe neural networks performed well on the four-organ classification task (F1 score: 96.3% for convolutional neural network and 96.7% for long short-term memory vs 89.9% for support vector machines, 93.9% for extreme gradient boosting, 82.8% for random forests, and 75.2% for simple string matching). Multiple methods were used to visualize the decision-making process of the network, verifying that the networks used similar heuristics to a human annotator. The neural networks were able to classify, with a high degree of accuracy, pathology reports written in unseen formats, suggesting the networks had learned a generalizable encoding of the salient features.ConclusionNeural network-based approaches achieve high performance on organ-level pathology report classification, suggesting that it is feasible to use them within automated tracking systems.© RSNA, 2019Supplemental material is available for this article.See also the commentary by Liu in this issue.
| S-EPMC8017395 | biostudies-literature
Project description:How does the concerted activity of neuronal populations shape behavior? Impediments to address this question are primarily due to critical experimental barriers. An integrated perspective on large scale neural information processing requires an in vivo approach that can combine the advantages of exhaustively observing all neurons dedicated to a given type of stimulus, and simultaneously achieve a resolution that is precise enough to capture individual neuron activity. Current experimental data from in vivo observations are either restricted to a small fraction of the total number of neurons, or are based on larger brain volumes but at a low spatial and temporal resolution. Consequently, fundamental questions as to how sensory information is represented on a population scale remain unanswered. In Drosophila melanogaster, the mushroom body (MB) represents an excellent model to analyze sensory coding and memory plasticity. In this work, we present an experimental setup coupled with a dedicated computational method that provides in vivo measurements of the activity of hundreds of densely packed somata uniformly spread in the MB. We exploit spinning-disk confocal 3D imaging over time of the whole MB cell body layer in vivo while it is exposed to olfactory stimulation. Importantly, to derive individual signal from densely packed somata, we have developed a fully automated image analysis procedure that takes advantage of the specificities of our data. After anisotropy correction, our approach operates a dedicated spot detection and registration over the entire time sequence to transform trajectories to identifiable clusters. This enabled us to discard spurious detections and reconstruct missing ones in a robust way. We demonstrate that this approach outperformed existing methods in this specific context and made possible high-throughput analysis of approximately 500 single somata uniformly spread over the MB in various conditions. Applying this approach, we find that learned experiences change the population code of odor representations in the MB. After long-term memory (LTM) formation, we quantified an increase in responsive somata count and a stable single neuron signal. We predict that this method, which should further enable studying the population pattern of neuronal activity, has the potential to uncover fine details of sensory processing and memory plasticity.
| S-EPMC7188892 | biostudies-literature
Project description:Animals rely on an internal sense of body position and movement to effectively control motor behavior. This sense of proprioception is mediated by diverse populations of mechanosensory neurons distributed throughout the body. Here, we investigate neural coding of leg proprioception in Drosophila, using in vivo two-photon calcium imaging of proprioceptive sensory neurons during controlled movements of the fly tibia. We found that the axons of leg proprioceptors are organized into distinct functional projections that contain topographic representations of specific kinematic features. Using subclass-specific genetic driver lines, we show that one group of axons encodes tibia position (flexion/extension), another encodes movement direction, and a third encodes bidirectional movement and vibration frequency. Overall, our findings reveal how proprioceptive stimuli from a single leg joint are encoded by a diverse population of sensory neurons, and provide a framework for understanding how proprioceptive feedback signals are used by motor circuits to coordinate the body.
| S-EPMC6481666 | biostudies-literature
Project description:Quantitative analysis of animal behaviour in model organisms is becoming an increasingly essential approach for tackling the great challenge of understanding how activity in the brain gives rise to behaviour. Here we used automated image-based tracking to extract behavioural features from an organism of great importance in understanding the evolution of chordates, the free-swimming larval form of the tunicate Ciona intestinalis, which has a compact and fully mapped nervous system composed of only 231 neurons. We analysed hundreds of videos of larvae and we extracted basic geometric and physical descriptors of larval behaviour. Importantly, we used machine learning methods to create an objective ontology of behaviours for C. intestinalis larvae. We identified eleven behavioural modes using agglomerative clustering. Using our pipeline for quantitative behavioural analysis, we demonstrate that C. intestinalis larvae exhibit sensory arousal and thigmotaxis. Notably, the anxiotropic drug modafinil modulates thigmotactic behaviour. Furthermore, we tested the robustness of the larval behavioural repertoire by comparing different rearing conditions, ages and group sizes. This study shows that C. intestinalis larval behaviour can be broken down to a set of stereotyped behaviours that are used to different extents in a context-dependent manner.
| S-EPMC6382837 | biostudies-literature
Project description:BackgroundIdentifying animal behaviors, life history states, and movement patterns is a prerequisite for many animal behavior analyses and effective management of wildlife and habitats. Most approaches classify short-term movement patterns with high frequency location or accelerometry data. However, patterns reflecting life history across longer time scales can have greater relevance to species biology or management needs, especially when available in near real-time. Given limitations in collecting and using such data to accurately classify complex behaviors in the long-term, we used hourly GPS data from 5 waterfowl species to produce daily activity classifications with machine-learned models using "automated modelling pipelines".MethodsAutomated pipelines are computer-generated code that complete many tasks including feature engineering, multi-framework model development, training, validation, and hyperparameter tuning to produce daily classifications from eight activity patterns reflecting waterfowl life history or movement states. We developed several input features for modeling grouped into three broad categories, hereafter "feature sets": GPS locations, habitat information, and movement history. Each feature set used different data sources or data collected across different time intervals to develop the "features" (independent variables) used in models.ResultsAutomated modelling pipelines rapidly developed easily reproducible data preprocessing and analysis steps, identification and optimization of the best performing model and provided outputs for interpreting feature importance. Unequal expression of life history states caused unbalanced classes, so we evaluated feature set importance using a weighted F1-score to balance model recall and precision among individual classes. Although the best model using the least restrictive feature set (only 24 hourly relocations in a day) produced effective classifications (weighted F1 = 0.887), models using all feature sets performed substantially better (weighted F1 = 0.95), particularly for rarer but demographically more impactful life history states (i.e., nesting).ConclusionsAutomated pipelines generated models producing highly accurate classifications of complex daily activity patterns using relatively low frequency GPS and incorporating more classes than previous GPS studies. Near real-time classification is possible which is ideal for time-sensitive needs such as identifying reproduction. Including habitat and longer sequences of spatial information produced more accurate classifications but incurred slight delays in processing.
| S-EPMC9109391 | biostudies-literature