Entropy Measures of Human Communication Dynamics.
Ontology highlight
ABSTRACT:
SUBMITTER: Kulisiewicz M
PROVIDER: S-EPMC6200760 | biostudies-literature | 2018 Oct
REPOSITORIES: biostudies-literature
Publications
Entropy Measures of Human Communication Dynamics.
Kulisiewicz Marcin M Kazienko Przemysław P Szymanski Boleslaw K BK Michalski Radosław R
Scientific reports 20181024 1
Human communication is commonly represented as a temporal social network, and evaluated in terms of its uniqueness. We propose a set of new entropy-based measures for human communication dynamics represented within the temporal social network as event sequences. Using real world datasets and random interaction series of different types we find that real human contact events always significantly differ from random ones. This human distinctiveness increases over time and by means of the proposed e ...[more]
Similar Datasets
Project description:Highlights? Twelve entropy indices were systematically compared in monitoring depth of anesthesia and detecting burst suppression.? Renyi permutation entropy performed best in tracking EEG changes associated with different anesthesia states.? Approximate Entropy and Sample Entropy performed best in detecting burst suppression.ObjectiveEntropy algorithms have been widely used in analyzing EEG signals during anesthesia. However, a systematic comparison of these entropy algorithms in assessing anesthesia drugs' effect is lacking. In this study, we compare the capability of 12 entropy indices for monitoring depth of anesthesia (DoA) and detecting the burst suppression pattern (BSP), in anesthesia induced by GABAergic agents.MethodsTwelve indices were investigated, namely Response Entropy (RE) and State entropy (SE), three wavelet entropy (WE) measures [Shannon WE (SWE), Tsallis WE (TWE), and Renyi WE (RWE)], Hilbert-Huang spectral entropy (HHSE), approximate entropy (ApEn), sample entropy (SampEn), Fuzzy entropy, and three permutation entropy (PE) measures [Shannon PE (SPE), Tsallis PE (TPE) and Renyi PE (RPE)]. Two EEG data sets from sevoflurane-induced and isoflurane-induced anesthesia respectively were selected to assess the capability of each entropy index in DoA monitoring and BSP detection. To validate the effectiveness of these entropy algorithms, pharmacokinetic/pharmacodynamic (PK/PD) modeling and prediction probability (Pk) analysis were applied. The multifractal detrended fluctuation analysis (MDFA) as a non-entropy measure was compared.ResultsAll the entropy and MDFA indices could track the changes in EEG pattern during different anesthesia states. Three PE measures outperformed the other entropy indices, with less baseline variability, higher coefficient of determination (R (2)) and prediction probability, and RPE performed best; ApEn and SampEn discriminated BSP best. Additionally, these entropy measures showed an advantage in computation efficiency compared with MDFA.ConclusionEach entropy index has its advantages and disadvantages in estimating DoA. Overall, it is suggested that the RPE index was a superior measure. Investigating the advantages and disadvantages of these entropy indices could help improve current clinical indices for monitoring DoA.
| S-EPMC4332344 | biostudies-literature
Project description:Most mammalian genes are able to express several splice variants in a phenomenon known as alternative splicing. Serious alterations of alternative splicing occur in cancer tissues, leading to expression of multiple aberrant splice forms. Most studies of alternative splicing defects have focused on the identification of cancer-specific splice variants as potential therapeutic targets. Here, we examine instead the bulk of non-specific transcript isoforms and analyze their level of disorder using a measure of uncertainty called Shannon's entropy. We compare isoform expression entropy in normal and cancer tissues from the same anatomical site for different classes of transcript variations: alternative splicing, polyadenylation, and transcription initiation. Whereas alternative initiation and polyadenylation show no significant gain or loss of entropy between normal and cancer tissues, alternative splicing shows highly significant entropy gains for 13 of the 27 cancers studied. This entropy gain is characterized by a flattening in the expression profile of normal isoforms and is correlated to the level of estimated cellular proliferation in the cancer tissue. Interestingly, the genes that present the highest entropy gain are enriched in splicing factors. We provide here the first quantitative estimate of splicing disruption in cancer. The expression of normal splice variants is widely and significantly disrupted in at least half of the cancers studied. We postulate that such splicing disorders may develop in part from splicing alteration in key splice factors, which in turn significantly impact multiple target genes.
| S-EPMC2268240 | biostudies-literature
Project description:Entropy based measures have been frequently used in symbolic sequence analysis. A symmetrized and smoothed form of Kullback-Leibler divergence or relative entropy, the Jensen-Shannon divergence (JSD), is of particular interest because of its sharing properties with families of other divergence measures and its interpretability in different domains including statistical physics, information theory and mathematical statistics. The uniqueness and versatility of this measure arise because of a number of attributes including generalization to any number of probability distributions and association of weights to the distributions. Furthermore, its entropic formulation allows its generalization in different statistical frameworks, such as, non-extensive Tsallis statistics and higher order Markovian statistics. We revisit these generalizations and propose a new generalization of JSD in the integrated Tsallis and Markovian statistical framework. We show that this generalization can be interpreted in terms of mutual information. We also investigate the performance of different JSD generalizations in deconstructing chimeric DNA sequences assembled from bacterial genomes including that of E. coli, S. enterica typhi, Y. pestis and H. influenzae. Our results show that the JSD generalizations bring in more pronounced improvements when the sequences being compared are from phylogenetically proximal organisms, which are often difficult to distinguish because of their compositional similarity. While small but noticeable improvements were observed with the Tsallis statistical JSD generalization, relatively large improvements were observed with the Markovian generalization. In contrast, the proposed Tsallis-Markovian generalization yielded more pronounced improvements relative to the Tsallis and Markovian generalizations, specifically when the sequences being compared arose from phylogenetically proximal organisms.
| S-EPMC3984095 | biostudies-literature
Project description:This article introduces three new variants of entropy to detect person misfit (Ei, EMi , and EMRi ), and provides preliminary evidence that these measures are worthy of further investigation. Previously, entropy has been used as a measure of approximate data-model fit to quantify how well individuals are classified into latent classes, and to quantify the quality of classification and separation between groups in logistic regression models. In the current study, entropy is explored through conceptual examples and Monte Carlo simulation comparing entropy with established measures of person fit in item response theory (IRT) such as lz, lz*, U, and W. Simulation results indicated that EMi and EMRi were successfully able to detect aberrant response patterns when comparing contaminated and uncontaminated subgroups of persons. In addition, EMi and EMRi performed similarly in showing separation between the contaminated and uncontaminated subgroups. However, EMRi may be advantageous over other measures when subtests include a small number of items. EMi and EMRi are recommended for use as approximate person-fit measures for IRT models. These measures of approximate person fit may be useful in making relative judgments about potential persons whose response patterns do not fit the theoretical model.
| S-EPMC5978476 | biostudies-literature
Project description:As a novel measure for irregularity and complexity of the spontaneous fluctuations of brain activities, brain entropy (BEN) has attracted much attention in resting-state functional magnetic resonance imaging (rs-fMRI) studies during the last decade. Previous studies have shown its associations with cognitive and mental functions. While most previous research assumes BEN is approximately stationary during scan sessions, the brain, even at its resting state, is a highly dynamic system. Such dynamics could be characterized by a series of reoccurring whole-brain patterns related to cognitive and mental processes. The present study aims to explore the time-varying feature of BEN and its potential links with general cognitive ability. We adopted a sliding window approach to derive the dynamical brain entropy (dBEN) of the whole-brain functional networks from the HCP (Human Connectome Project) rs-fMRI dataset that includes 812 young healthy adults. The dBEN was further clustered into 4 reoccurring BEN states by the k-means clustering method. The fraction window (FW) and mean dwell time (MDT) of one BEN state, characterized by the extremely low overall BEN, were found to be negatively correlated with general cognitive abilities (i.e., cognitive flexibility, inhibitory control, and processing speed). Another BEN state, characterized by intermediate overall BEN and low within-state BEN located in DMN, ECN, and part of SAN, its FW, and MDT were positively correlated with the above cognitive abilities. The results of our study advance our understanding of the underlying mechanism of BEN dynamics and provide a potential framework for future investigations in clinical populations.
| S-EPMC11002175 | biostudies-literature
Project description:We propose a definition of entropy for stochastic processes. We provide a reproducing kernel Hilbert space model to estimate entropy from a random sample of realizations of a stochastic process, namely functional data, and introduce two approaches to estimate minimum entropy sets. These sets are relevant to detect anomalous or outlier functional data. A numerical experiment illustrates the performance of the proposed method; in addition, we conduct an analysis of mortality rate curves as an interesting application in a real-data context to explore functional anomaly detection.
| S-EPMC7512230 | biostudies-literature
Project description:Changes in residual conformational entropy of proteins can be significant components of the thermodynamics of folding and binding. Nuclear magnetic resonance (NMR) spin relaxation is the only experimental technique capable of probing local protein entropy, by inference from local internal conformational dynamics. To assess the validity of this approach, the picosecond-to-nanosecond dynamics of the arginine side-chain N(epsilon)-H(epsilon) bond vectors of Escherichia coli ribonuclease H (RNase H) were determined by NMR spin relaxation and compared to the mechanistic detail provided by molecular dynamics (MD) simulations. The results indicate that arginine N(epsilon) spin relaxation primarily reflects persistence of guanidinium salt bridges and correlates well with simulated side-chain conformational entropy. In particular cases, the simulations show that the aliphatic part of the arginine side chain can retain substantial disorder while the guanidinium group maintains its salt bridges; thus, the N(epsilon)-H(epsilon) bond-vector orientation is conserved and side-chain flexibility is concealed from N(epsilon) spin relaxation. The MD simulations and an analysis of a rotamer library suggest that dynamic decoupling of the terminal moiety from the remainder of the side chain occurs for all five amino acids with more than two side-chain dihedral angles (R, K, E, Q, and M). Dynamic decoupling thus may represent a general biophysical strategy for minimizing the entropic penalties of folding and binding.
| S-EPMC2683258 | biostudies-literature
Project description:Using Brownian dynamics simulations, we study the effective mobility and diffusion coefficient of a point particle in a tube formed from identical compartments of varying diameter, as functions of the driving force applied along the tube axis. Our primary focus is on how the driving force dependences of these transport coefficients are modified by the changes in the compartment shape. In addition to monotonically increasing or decreasing behavior of the effective mobility in periodic entropy potentials reported earlier, we now show that the effective mobility can even be nonmonotonic in the driving force.
| S-EPMC3069984 | biostudies-other
Project description:Temperature control is a process that is used by biological systems to maintain a stable internal state for survival. People have an individually variable physiological temperature of about 36.6 °C, which can be modified by many undesirable factors. Based on an analysis of a time series of extracellular ionic fluxes that were obtained using the non-invasive solute-semiconductor interface technique, I show that this extremely specific (critical) temperature is encoded by a local minimum in the dynamic entropy of an isolated drop of human blood. Moreover, a dynamic zeroth-order normal fluid/"superfluid" nonequilibrium phase transition, which was reflected by a spontaneous symmetry breaking that occurred in the phase space, was revealed. The critical scaling of the dynamic measures for the covariates such as the spectral signature and Lyapunov exponent was also determined.
| S-EPMC8026995 | biostudies-literature
Project description:With the unfolding of the COVID-19 pandemic, mathematical modelling of epidemics has been perceived and used as a central element in understanding, predicting, and governing the pandemic event. However, soon it became clear that long-term predictions were extremely challenging to address. In addition, it is still unclear which metric shall be used for a global description of the evolution of the outbreaks. Yet a robust modelling of pandemic dynamics and a consistent choice of the transmission metric is crucial for an in-depth understanding of the macroscopic phenomenology and better-informed mitigation strategies. In this study, we propose a Markovian stochastic framework designed for describing the evolution of entropy during the COVID-19 pandemic together with the instantaneous reproductive ratio. Then, we introduce and use entropy-based metrics of global transmission to measure the impact and the temporal evolution of a pandemic event. In the formulation of the model, the temporal evolution of the outbreak is modelled by an equation governing the probability distribution that describes a nonlinear Markov process of a statistically averaged individual, leading to a clear physical interpretation. The time-dependent parameters are formulated by adaptive basis functions, leading to a parsimonious representation. In addition, we provide a full Bayesian inversion scheme for calibration together with a coherent strategy to address data unreliability. The time evolution of the entropy rate, the absolute change in the system entropy, and the instantaneous reproductive ratio are natural and transparent outputs of this framework. The framework has the appealing property of being applicable to any compartmental epidemic model. As an illustration, we apply the proposed approach to a simple modification of the susceptible-exposed-infected-removed model. Applying the model to the Hubei region, South Korean, Italian, Spanish, German, and French COVID-19 datasets, we discover significant difference in the absolute change of entropy but highly regular trends for both the entropy evolution and the instantaneous reproductive ratio.
| S-EPMC7480665 | biostudies-literature