Jackknife approach to the estimation of mutual information.
Ontology highlight
ABSTRACT:
SUBMITTER: Zeng X
PROVIDER: S-EPMC6176556 | biostudies-literature | 2018 Oct
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Measuring information transmission from stimulus to response is useful for evaluating the signaling fidelity of biochemical reaction networks (BRNs) in cells. Quantification of information transmission can reveal the optimal input stimuli environment for a BRN and the rate at which the signaling fidelity decreases for non-optimal input probability distributions. Here we present sparse estimation of mutual information landscapes (SEMIL), a method to quantify information transmission through cellular BRNs using commonly available data for single-cell gene expression output, across a design space of possible input distributions. We validate SEMIL and use it to analyze several engineered cellular sensing systems to demonstrate the impact of reaction pathways and rate constants on mutual information landscapes.
| S-EPMC7192899 | biostudies-literature
Project description:Although microarray gene expression analysis has become popular, it remains difficult to interpret the biological changes caused by stimuli or variation of conditions. Clustering of genes and associating each group with biological functions are often used methods. However, such methods only detect partial changes within cell processes. Herein, we propose a method for discovering global changes within a cell by associating observed conditions of gene expression with gene functions.To elucidate the association, we introduce a novel feature selection method called Least-Squares Mutual Information (LSMI), which computes mutual information without density estimaion, and therefore LSMI can detect nonlinear associations within a cell. We demonstrate the effectiveness of LSMI through comparison with existing methods. The results of the application to yeast microarray datasets reveal that non-natural stimuli affect various biological processes, whereas others are no significant relation to specific cell processes. Furthermore, we discover that biological processes can be categorized into four types according to the responses of various stimuli: DNA/RNA metabolism, gene expression, protein metabolism, and protein localization.We proposed a novel feature selection method called LSMI, and applied LSMI to mining the association between conditions of yeast and biological processes through microarray datasets. In fact, LSMI allows us to elucidate the global organization of cellular process control.
| S-EPMC2648797 | biostudies-literature
Project description:Introducing tumor-derived cells into normal mammary stem cell niches at a sufficiently high ratio of normal to tumorous cells causes those tumor cells to undergo a change to normal mammary phenotype and yield normal mammary progeny. This phenomenon has been termed cancer cell redirection. We have developed an in vitro model that mimics in vivo redirection of cancer cells by the normal mammary microenvironment. Using the RNA profiling data from this cellular model, we examined high-level characteristics of the normal, redirected, and tumor transcriptomes and found the global expression profiles clearly distinguish the three expression states. To identify potential redirection biomarkers that cause the redirected state to shift toward the normal expression pattern, we used mutual information relationships between normal, redirected, and tumor cell groups. Mutual information relationship analysis reduced a dataset of over 35,000 gene expression measurements spread over 13,000 curated gene sets to a set of 20 significant molecular signatures totaling 906 unique loci. Several of these molecular signatures are hallmark drivers of the tumor state. Using differential expression as a guide, we further refined the gene set to 120 core redirection biomarker genes. The expression levels of these core biomarkers are sufficient to make the normal and redirected gene expression states indistinguishable from each other but radically different from the tumor state.
| S-EPMC5464651 | biostudies-literature
Project description:Ventricular fibrillation (VF) signals are characterized by highly volatile and erratic electrical impulses, the analysis of which is difficult given the complex behavior of the heart rhythms in the left (LV) and right ventricles (RV), as sometimes shown in intracardiac recorded Electrograms (EGM). However, there are few studies that analyze VF in humans according to the simultaneous behavior of heart signals in the two ventricles. The objective of this work was to perform a spectral and a non-linear analysis of the recordings of 22 patients with Congestive Heart Failure (CHF) and clinical indication for a cardiac resynchronization device, simultaneously obtained in LV and RV during induced VF in patients with a Biventricular Implantable Cardioverter Defibrillator (BICD) Contak Renewal IVTM (Boston Sci.). The Fourier Transform was used to identify the spectral content of the first six seconds of signals recorded in the RV and LV simultaneously. In addition, measurements that were based on Information Theory were scrutinized, including Entropy and Mutual Information. The results showed that in most patients the spectral envelopes of the EGM sources of RV and LV were complex, different, and with several frequency peaks. In addition, the Dominant Frequency (DF) in the LV was higher than in the RV, while the Organization Index (OI) had the opposite trend. The entropy measurements were more regular in the RV than in the LV, thus supporting the spectral findings. We can conclude that basic stochastic processing techniques should be scrutinized with caution and from basic to elaborated techniques, but they can provide us with useful information on the biosignals from both ventricles during VF.
| S-EPMC7435921 | biostudies-literature
Project description:A novel jackknife empirical likelihood method for constructing confidence intervals for multiply robust estimators is proposed in the context of missing data. Under mild regularity conditions, the proposed jackknife empirical likelihood ratio has been shown to converge to a standard chi-square distribution. A simulation study supports the findings and shows the benefits of the proposed method. The latter has also been applied to 2016 National Health Interview Survey data.
| S-EPMC6292709 | biostudies-literature
Project description:Interneurons are important for computation in the brain, in particular, in the information processing involving the generation of theta oscillations in the hippocampus. Yet the functional role of interneurons in the theta generation remains to be elucidated. Here we use time-delayed mutual information to investigate information flow related to a special class of interneurons-theta-driving neurons in the hippocampal CA1 region of the mouse-to characterize the interactions between theta-driving neurons and theta oscillations. For freely behaving mice, our results show that information flows from the activity of theta-driving neurons to the theta wave, and the firing activity of theta-driving neurons shares a substantial amount of information with the theta wave regardless of behavioral states. Via realistic simulations of a CA1 pyramidal neuron, we further demonstrate that theta-driving neurons possess the characteristics of the cholecystokinin-expressing basket cells (CCK-BC). Our results suggest that it is important to take into account the role of CCK-BC in the generation and information processing of theta oscillations.
| S-EPMC5514076 | biostudies-literature
Project description:How should one quantify the strength of association between two random variables without bias for relationships of a specific form? Despite its conceptual simplicity, this notion of statistical "equitability" has yet to receive a definitive mathematical formalization. Here we argue that equitability is properly formalized by a self-consistency condition closely related to Data Processing Inequality. Mutual information, a fundamental quantity in information theory, is shown to satisfy this equitability criterion. These findings are at odds with the recent work of Reshef et al. [Reshef DN, et al. (2011) Science 334(6062):1518-1524], which proposed an alternative definition of equitability and introduced a new statistic, the "maximal information coefficient" (MIC), said to satisfy equitability in contradistinction to mutual information. These conclusions, however, were supported only with limited simulation evidence, not with mathematical arguments. Upon revisiting these claims, we prove that the mathematical definition of equitability proposed by Reshef et al. cannot be satisfied by any (nontrivial) dependence measure. We also identify artifacts in the reported simulation evidence. When these artifacts are removed, estimates of mutual information are found to be more equitable than estimates of MIC. Mutual information is also observed to have consistently higher statistical power than MIC. We conclude that estimating mutual information provides a natural (and often practical) way to equitably quantify statistical associations in large datasets.
| S-EPMC3948249 | biostudies-other
Project description:The accurate classification of microbes is critical in today's context for monitoring the ecological balance of a habitat. Hence, in this research work, a novel method to automate the process of identifying microorganisms has been implemented. To extract the bodies of microorganisms accurately, a generalized segmentation mechanism which consists of a combination of convolution filter (Kirsch) and a variance-based pixel clustering algorithm (Otsu) is proposed. With exhaustive corroboration, a set of twenty-five features were identified to map the characteristics and morphology for all kinds of microbes. Multiple techniques for feature selection were tested and it was found that mutual information (MI)-based models gave the best performance. Exhaustive hyperparameter tuning of multilayer layer perceptron (MLP), k-nearest neighbors (KNN), quadratic discriminant analysis (QDA), logistic regression (LR), and support vector machine (SVM) was done. It was found that SVM radial required further improvisation to attain a maximum possible level of accuracy. Comparative analysis between SVM and improvised SVM (ISVM) through a 10-fold cross validation method ultimately showed that ISVM resulted in a 2% higher performance in terms of accuracy (98.2%), precision (98.2%), recall (98.1%), and F1 score (98.1%).
| S-EPMC7927045 | biostudies-literature
Project description:MotivationThe question of how to construct gene regulatory networks has long been a focus of biological research. Mutual information can be used to measure nonlinear relationships, and it has been widely used in the construction of gene regulatory networks. However, this method cannot measure indirect regulatory relationships under the influence of multiple genes, which reduces the accuracy of inferring gene regulatory networks.ApproachThis work proposes a method for constructing gene regulatory networks based on mixed entropy optimizing context-related likelihood mutual information (MEOMI). First, two entropy estimators were combined to calculate the mutual information between genes. Then, distribution optimization was performed using a context-related likelihood algorithm to eliminate some indirect regulatory relationships and obtain the initial gene regulatory network. To obtain the complex interaction between genes and eliminate redundant edges in the network, the initial gene regulatory network was further optimized by calculating the conditional mutual inclusive information (CMI2) between gene pairs under the influence of multiple genes. The network was iteratively updated to reduce the impact of mutual information on the overestimation of the direct regulatory intensity.ResultsThe experimental results show that the MEOMI method performed better than several other kinds of gene network construction methods on DREAM challenge simulated datasets (DREAM3 and DREAM5), three real Escherichia coli datasets (E.coli SOS pathway network, E.coli SOS DNA repair network and E.coli community network) and two human datasets.Availability and implementationSource code and dataset are available at https://github.com/Dalei-Dalei/MEOMI/ and http://122.205.95.139/MEOMI/.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC9805593 | biostudies-literature
Project description:The amount of information exchanged per unit of time between two nodes in a dynamical network or between two data sets is a powerful concept for analysing complex systems. This quantity, known as the mutual information rate (MIR), is calculated from the mutual information, which is rigorously defined only for random systems. Moreover, the definition of mutual information is based on probabilities of significant events. This work offers a simple alternative way to calculate the MIR in dynamical (deterministic) networks or between two time series (not fully deterministic), and to calculate its upper and lower bounds without having to calculate probabilities, but rather in terms of well known and well defined quantities in dynamical systems. As possible applications of our bounds, we study the relationship between synchronisation and the exchange of information in a system of two coupled maps and in experimental networks of coupled oscillators.
| S-EPMC3480398 | biostudies-literature