Detecting causality from nonlinear dynamics with short-term time series.
Ontology highlight
ABSTRACT:
SUBMITTER: Ma H
PROVIDER: S-EPMC5376982 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A key challenge to gaining insight into complex systems is inferring nonlinear causal directional relations from observational time-series data. Specifically, estimating causal relationships between interacting components in large systems with only short recordings over few temporal observations remains an important, yet unresolved problem. Here, we introduce large-scale nonlinear Granger causality (lsNGC) which facilitates conditional Granger causality between two multivariate time series conditioned on a large number of confounding time series with a small number of observations. By modeling interactions with nonlinear state-space transformations from limited observational data, lsNGC identifies casual relations with no explicit a priori assumptions on functional interdependence between component time series in a computationally efficient manner. Additionally, our method provides a mathematical formulation revealing statistical significance of inferred causal relations. We extensively study the ability of lsNGC in inferring directed relations from two-node to thirty-four node chaotic time-series systems. Our results suggest that lsNGC captures meaningful interactions from limited observational data, where it performs favorably when compared to traditionally used methods. Finally, we demonstrate the applicability of lsNGC to estimating causality in large, real-world systems by inferring directional nonlinear, causal relationships among a large number of relatively short time series acquired from functional Magnetic Resonance Imaging (fMRI) data of the human brain.
| S-EPMC8035412 | biostudies-literature
Project description:Identifying causal relationships and quantifying their strength from observational time series data are key problems in disciplines dealing with complex dynamical systems such as the Earth system or the human body. Data-driven causal inference in such systems is challenging since datasets are often high dimensional and nonlinear with limited sample sizes. Here, we introduce a novel method that flexibly combines linear or nonlinear conditional independence tests with a causal discovery algorithm to estimate causal networks from large-scale time series datasets. We validate the method on time series of well-understood physical mechanisms in the climate system and the human heart and using large-scale synthetic datasets mimicking the typical properties of real-world data. The experiments demonstrate that our method outperforms state-of-the-art techniques in detection power, which opens up entirely new possibilities to discover and quantify causal networks from time series across a range of research fields.
| S-EPMC6881151 | biostudies-literature
Project description:We show that, statistically, the simple linear regression (SLR)-determined rate of temporal change in seawater pH (?pH), the so-called acidification rate, can be expressed as a linear combination of a constant (the estimated rate of temporal change in pH) and SLR-determined rates of temporal changes in other variables (deviation largely due to various sampling distributions), despite complications due to different observation durations and temporal sampling distributions. Observations show that five time series data sets worldwide, with observation times from 9 to 23 years, have yielded ?pH values that vary from 1.61 × 10(-3) to -2.5 × 10(-3) pH unit yr(-1). After correcting for the deviation, these data now all yield an acidification rate similar to what is expected under the air-sea CO2 equilibrium (-1.6 × 10(-3)?~?-1.8 × 10(-3) pH unit yr(-1)). Although long-term time series stations may have evenly distributed datasets, shorter time series may suffer large errors which are correctable by this method.
| S-EPMC4648385 | biostudies-literature
Project description:Nonlinear phenomena are universal in ecology. However, their inference and prediction are generally difficult because of autocorrelation and outliers. A traditional least squares method for parameter estimation is capable of improving short-term prediction by estimating autocorrelation, whereas it has weakness to outliers and consequently worse long-term prediction. In contrast, a traditional robust regression approach, such as the least absolute deviations method, alleviates the influence of outliers and has potentially better long-term prediction, whereas it makes accurately estimating autocorrelation difficult and possibly leads to worse short-term prediction. We propose a new robust regression approach that estimates autocorrelation accurately and reduces the influence of outliers. We then compare the new method with the conventional least squares and least absolute deviations methods by using simulated data and real ecological data. Simulations and analysis of real data demonstrate that the new method generally has better long-term and short-term prediction ability for nonlinear estimation problems using spawner-recruitment data. The new method provides nearly unbiased autocorrelation even for highly contaminated simulated data with extreme outliers, whereas other methods fail to estimate autocorrelation accurately.
| S-EPMC8184922 | biostudies-literature
Project description:Background. Establishing health-related causal relationships is a central pursuit in biomedical research. Yet, the interdependent non-linearity of biological systems renders causal dynamics laborious and at times impractical to disentangle. This pursuit is further impeded by the dearth of time series that are sufficiently long to observe and understand recurrent patterns of flux. However, as data generation costs plummet and technologies like wearable devices democratize data collection, we anticipate a coming surge in the availability of biomedically-relevant time series data. Given the life-saving potential of these burgeoning resources, it is critical to invest in the development of open source software tools that are capable of drawing meaningful insight from vast amounts of time series data. Results. Here we present CauseMap, the first open source implementation of convergent cross mapping (CCM), a method for establishing causality from long time series data (?25 observations). Compared to existing time series methods, CCM has the advantage of being model-free and robust to unmeasured confounding that could otherwise induce spurious associations. CCM builds on Takens' Theorem, a well-established result from dynamical systems theory that requires only mild assumptions. This theorem allows us to reconstruct high dimensional system dynamics using a time series of only a single variable. These reconstructions can be thought of as shadows of the true causal system. If reconstructed shadows can predict points from opposing time series, we can infer that the corresponding variables are providing views of the same causal system, and so are causally related. Unlike traditional metrics, this test can establish the directionality of causation, even in the presence of feedback loops. Furthermore, since CCM can extract causal relationships from times series of, e.g., a single individual, it may be a valuable tool to personalized medicine. We implement CCM in Julia, a high-performance programming language designed for facile technical computing. Our software package, CauseMap, is platform-independent and freely available as an official Julia package. Conclusions. CauseMap is an efficient implementation of a state-of-the-art algorithm for detecting causality from time series data. We believe this tool will be a valuable resource for biomedical research and personalized medicine.
| S-EPMC4359046 | biostudies-literature
Project description:Biotic interactions are expected to play a major role in shaping the dynamics of ecological systems. Yet, quantifying the effects of biotic interactions has been challenging due to a lack of appropriate methods to extract accurate measurements of interaction parameters from experimental data. One of the main limitations of existing methods is that the parameters inferred from noisy, sparsely sampled, nonlinear data are seldom uniquely identifiable. That is, many different parameters can be compatible with the same dataset and can generalize to independent data equally well. Hence, it is difficult to justify conclusive assertions about the effect of biotic interactions without information about their associated uncertainty. Here, we develop an ensemble method based on model averaging to quantify the uncertainty associated with the effect of biotic interactions on community dynamics from non-equilibrium ecological time-series data. Our method is able to detect the most informative time intervals for each biotic interaction within a multivariate time series and can be easily adapted to different regression schemes. Overall, this novel approach can be used to associate a time-dependent uncertainty with the effect of biotic interactions. Moreover, because we quantify uncertainty with minimal assumptions about the data-generating process, our approach can be applied to any data for which interactions among variables strongly affect the overall dynamics of the system.
| S-EPMC6228481 | biostudies-literature
Project description:The control mechanisms and implications of heart rate variability (HRV) under the sympathetic (SNS) and parasympathetic nervous system (PNS) modulation remain poorly understood. Here, we establish the HR model/HRV responder using a nonlinear process derived from Newton's second law in stochastic self-restoring systems through dynamic analysis of physiological properties. We conduct model validation by testing, predictions, simulations, and sensitivity and time-scale analysis. We confirm that the outputs of the HRV responder can be accepted as the real data-generating process. Empirical studies show that the dynamic control mechanism of heart rate is a stable fixed point, rather than a strange attractor or transitions between a fixed point and a limit cycle; HR slope (amplitude) may depend on the ratio of cardiac disturbance or metabolic demand mean (standard deviation) to myocardial electrical resistance (PNS-SNS activity). For example, when metabolic demands remain unchanged, HR amplitude depends on PNS to SNS activity; when autonomic activity remains unchanged, HR amplitude during resting reflects basal metabolism. HR parameter alterations suggest that age-related decreased HRV, ultrareduced HRV in heart failure, and ultraelevated HRV in ST segment alterations refer to age-related decreased basal metabolism, impaired myocardial metabolism, and SNS hyperactivity triggered by myocardial ischemia, respectively.
| S-EPMC7075874 | biostudies-literature
Project description:A fundamental problem in research on biological rhythms is that of detecting and assessing the significance of rhythms in large sets of data. Classic methods based on Fourier theory are often hampered by the complex and unpredictable characteristics of experimental and biological noise. Robust nonparametric methods are available but are limited to specific wave forms. We present RAIN, a robust nonparametric method for the detection of rhythms of prespecified periods in biological data that can detect arbitrary wave forms. When applied to measurements of the circadian transcriptome and proteome of mouse liver, the sets of transcripts and proteins with rhythmic abundances were significantly expanded due to the increased detection power, when we controlled for false discovery. Validation against independent data confirmed the quality of these results. The large expansion of the circadian mouse liver transcriptomes and proteomes reflected the prevalence of nonsymmetric wave forms and led to new conclusions about function. RAIN was implemented as a freely available software package for R/Bioconductor and is presently also available as a web interface.
| S-EPMC4266694 | biostudies-literature
Project description:The COVID-19 pandemic has revealed substantial coverage and quality gaps in existing international and national statistical monitoring systems. It is striking that obtaining timely, accurate, and comparable across countries data in order to adequately respond to unexpected epidemiological threats is very challenging. The most robust and reliable approach to quantify the mortality burden due to short-term risk factors is based on estimating weekly excess deaths. This approach is more reliable than monitoring deaths with COVID-19 diagnosis or calculating incidence or fatality rates affected by numerous problems such as testing coverage and comparability of diagnostic approaches. In response to the emerging data challenges, a new data resource on weekly mortality has been established. The Short-term Mortality Fluctuations (STMF, available at www.mortality.org ) data series is the first international database providing open-access harmonized, uniform, and fully documented data on weekly all-cause mortality. The STMF online vizualisation tool provides an opportunity to perform a quick assessment of the excess weekly mortality in one or several countries by means of an interactive graphical interface.
| S-EPMC8421508 | biostudies-literature
Project description:Microarray time-course data can be used to explore interactions among genes and infer gene network. The crucial step in constructing gene network is to develop an appropriate causality test. In this regard, the expression profile of each gene can be treated as a time series. A typical existing method establishes the Granger causality based on Wald type of test, which relies on the homoscedastic normality assumption of the data distribution. However, this assumption can be seriously violated in real microarray experiments and thus may lead to inconsistent test results and false scientific conclusions. To overcome the drawback, we propose an estimating equation-based method which is robust to both heteroscedasticity and nonnormality of the gene expression data. In fact, it only requires the residuals to be uncorrelated. We will use simulation studies and a real-data example to demonstrate the applicability of the proposed method.
| S-EPMC2697343 | biostudies-literature