Dataset Information

Measuring context dependency in birdsong using artificial neural networks.

ABSTRACT: Context dependency is a key feature in sequential structures of human language, which requires reference between words far apart in the produced sequence. Assessing how long the past context has an effect on the current status provides crucial information to understand the mechanism for complex sequential behaviors. Birdsongs serve as a representative model for studying the context dependency in sequential signals produced by non-human animals, while previous reports were upper-bounded by methodological limitations. Here, we newly estimated the context dependency in birdsongs in a more scalable way using a modern neural-network-based language model whose accessible context length is sufficiently long. The detected context dependency was beyond the order of traditional Markovian models of birdsong, but was consistent with previous experimental investigations. We also studied the relation between the assumed/auto-detected vocabulary size of birdsong (i.e., fine- vs. coarse-grained syllable classifications) and the context dependency. It turned out that the larger vocabulary (or the more fine-grained classification) is assumed, the shorter context dependency is detected.

SUBMITTER: Morita T

PROVIDER: S-EPMC8746767 | biostudies-literature | 2021 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring context dependency in birdsong using artificial neural networks.

Morita Takashi T Koda Hiroki H Okanoya Kazuo K Tachibana Ryosuke O RO

PLoS computational biology 20211228 12

Context dependency is a key feature in sequential structures of human language, which requires reference between words far apart in the produced sequence. Assessing how long the past context has an effect on the current status provides crucial information to understand the mechanism for complex sequential behaviors. Birdsongs serve as a representative model for studying the context dependency in sequential signals produced by non-human animals, while previous reports were upper-bounded by method ...[more]

PMID: 34962915

Similar Datasets

Project description:One way to better understand the structure in DNA is by learning to predict the sequence. Here, we trained a model to predict the missing base at any given position, given its left and right flanking contexts. Our best-performing model was a neural network that obtained an accuracy close to 54% on the human genome, which is 2% points better than modelling the data using a Markov model. In likelihood-ratio tests, the neural network performed significantly better than any of the alternative models by a large margin. We report on where the accuracy was obtained, first observing that the performance appeared to be uniform over the chromosomes. The models performed best in repetitive sequences, as expected, although their performance far from random in the more difficult coding sections, the proportions being ~70:40%. We further explored the sources of the accuracy, Fourier transforming the predictions revealed weak but clear periodic signals. In the human genome the characteristic periods hinted at connections to nucleosome positioning. We found similar periodic signals in GC/AT content in the human genome, which to the best of our knowledge have not been reported before. On other large genomes similarly high accuracy was found, while lower predictive accuracy was observed on smaller genomes. Only in the mouse genome did we see periodic signals in the same range as in the human genome, though weaker and of a different type. This indicates that the sources of these signals are other or more than nucleosome arrangement. Interestingly, applying a model trained on the mouse genome to the human genome resulted in a performance far below that of the human model, except in the difficult coding regions. Despite the clear outcomes of the likelihood-ratio tests, there is currently a limited superiority of the neural network methods over the Markov model. We expect, however, that there is great potential for better modelling DNA using different neural network architectures.

Project description:BackgroundCraniosynostosis, a congenital condition characterized by the premature fusion of cranial sutures, necessitates objective methods for evaluating cranial morphology to enhance patient treatment. Current subjective assessments often lead to inconsistent outcomes. This study introduces a novel, quantitative approach to classify craniosynostosis and measure its severity.MethodsAn artificial neural network was trained to classify normocephalic, trigonocephalic, and scaphocephalic head shapes based on a publicly available dataset of synthetic 3D head models. Each 3D model was converted into a low-dimensional shape representation based on the distribution of normal vectors, which served as the input for the neural network, ensuring complete patient anonymity and invariance to geometric size and orientation. Explainable AI methods were utilized to highlight significant features when making predictions. Additionally, the Feature Prominence (FP) score was introduced, a novel metric that captures the prominence of distinct shape characteristics associated with a given class. Its relationship with clinical severity scores was examined using the Spearman Rank Correlation Coefficient.ResultsThe final model achieved excellent test accuracy in classifying the different cranial shapes from their low-dimensional representation. Attention maps indicated that the network's attention was predominantly directed toward the parietal and temporal regions, as well as toward the region signifying vertex depression in scaphocephaly. In trigonocephaly, features around the temples were most pronounced. The FP score showed a strong positive monotonic relationship with clinical severity scores in both scaphocephalic (ρ = 0.83, p < 0.001) and trigonocephalic (ρ = 0.64, p < 0.001) models. Visual assessments further confirmed that as FP values rose, phenotypic severity became increasingly evident.ConclusionThis study presents an innovative and accessible AI-based method for quantifying cranial shape that mitigates the need for adjustments due to age-specific size variations or differences in the spatial orientation of the 3D images, while ensuring complete patient privacy. The proposed FP score strongly correlates with clinical severity scores and has the potential to aid in clinical decision-making and facilitate multi-center collaborations. Future work will focus on validating the model with larger patient datasets and exploring the potential of the FP score for broader applications. The publicly available source code facilitates easy implementation, aiming to advance craniofacial care and research.

Dataset Information

Measuring context dependency in birdsong using artificial neural networks.

Publications

Measuring context dependency in birdsong using artificial neural networks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets