Dataset Information

A family of functional dissimilarity measures for presence and absence data.

ABSTRACT: Plot-to-plot dissimilarity measures are considered a valuable tool for understanding the complex ecological mechanisms that drive community composition. Traditional presence/absence coefficients are usually based on different combinations of the matching/mismatching components of the 2 × 2 contingency table. However, more recently, dissimilarity measures that incorporate information about the degree of functional differences between the species in both plots have received increasing attention. This is because such "functional dissimilarity measures" capture information on the species' functional traits, which is ignored by traditional coefficients. Therefore, functional dissimilarity measures tend to correlate more strongly with ecosystem-level processes, as species influence these processes via their traits. In this study, we introduce a new family of dissimilarity measures for presence and absence data, which consider functional dissimilarities among species in the calculation of the matching/mismatching components of the 2 × 2 contingency table. Within this family, the behavior of the Jaccard coefficient, together with its additive components, species replacement, and richness difference, is examined by graphical comparisons and ordinations based on simulated data.

SUBMITTER: Ricotta C

PROVIDER: S-EPMC4984511 | biostudies-literature | 2016 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A family of functional dissimilarity measures for presence and absence data.

Ricotta Carlo C Podani János J Pavoine Sandrine S

Ecology and evolution 20160705 15

Plot-to-plot dissimilarity measures are considered a valuable tool for understanding the complex ecological mechanisms that drive community composition. Traditional presence/absence coefficients are usually based on different combinations of the matching/mismatching components of the 2 × 2 contingency table. However, more recently, dissimilarity measures that incorporate information about the degree of functional differences between the species in both plots have received increasing attention. T ...[more]

PMID: 27551390

Similar Datasets

Project description:Sample- and gene-based hierarchical cluster analyses have been widely adopted as tools for exploring gene expression data in high-throughput experiments. Gene expression values (read counts) generated by RNA sequencing technology (RNA-seq) are discrete variables with special statistical properties, such as over-dispersion and right-skewness. Additionally, read counts are subject to technology artifacts as differences in sequencing depth. This possesses a challenge to finding distance measures suitable for hierarchical clustering. Normalization and transformation procedures have been proposed to favor the use of Euclidean and correlation based distances. Additionally, novel model-based dissimilarities that account for RNA-seq data characteristics have also been proposed. Adequacy of dissimilarity measures has been assessed using parametric simulations or exemplar datasets that may limit the scope of the conclusions. Here, we propose the simulation of realistic conditions through creation of plasmode datasets, to assess the adequacy of dissimilarity measures for sample-based hierarchical clustering of RNA-seq data. Consistent results were obtained using plasmode datasets based on RNA-seq experiments conducted under widely different conditions. Dissimilarity measures based on Euclidean distance that only considered data normalization or data standardization were not reliable to represent the expected hierarchical structure. Conversely, using either a Poisson-based dissimilarity or a rank correlation based dissimilarity or an appropriate data transformation, resulted in dendrograms that resemble the expected hierarchical structure. Plasmode datasets can be generated for a wide range of scenarios upon which dissimilarity measures can be evaluated for sample-based hierarchical clustering analysis. We showed different ways of generating such plasmodes and applied them to the problem of selecting a suitable dissimilarity measure. We report several measures that are satisfactory and the choice of a particular measure may rely on the availability on the software pipeline of preference.

Project description:BACKGROUND: Existing sequence alignment algorithms use heuristic scoring schemes based on biological expertise, which cannot be used as objective distance metrics. As a result one relies on crude measures, like the p- or log-det distances, or makes explicit, and often too simplistic, a priori assumptions about sequence evolution. Information theory provides an alternative, in the form of mutual information (MI). MI is, in principle, an objective and model independent similarity measure, but it is not widely used in this context and no algorithm for extracting MI from a given alignment (without assuming an evolutionary model) is known. MI can be estimated without alignments, by concatenating and zipping sequences, but so far this has only produced estimates with uncontrolled errors, despite the fact that the normalized compression distance based on it has shown promising results. RESULTS: We describe a simple approach to get robust estimates of MI from global pairwise alignments. Our main result uses algorithmic (Kolmogorov) information theory, but we show that similar results can also be obtained from Shannon theory. For animal mitochondrial DNA our approach uses the alignments made by popular global alignment algorithms to produce MI estimates that are strikingly close to estimates obtained from the alignment free methods mentioned above. We point out that, due to the fact that it is not additive, normalized compression distance is not an optimal metric for phylogenetics but we propose a simple modification that overcomes the issue of additivity. We test several versions of our MI based distance measures on a large number of randomly chosen quartets and demonstrate that they all perform better than traditional measures like the Kimura or log-det (resp. paralinear) distances. CONCLUSIONS: Several versions of MI based distances outperform conventional distances in distance-based phylogeny. Even a simplified version based on single letter Shannon entropies, which can be easily incorporated in existing software packages, gave superior results throughout the entire animal kingdom. But we see the main virtue of our approach in a more general way. For example, it can also help to judge the relative merits of different alignment algorithms, by estimating the significance of specific alignments. It strongly suggests that information theory concepts can be exploited further in sequence analysis.

Project description:BackgroundA survey of presences and absences of specific species across multiple biogeographic units (or bioregions) are used in a broad area of biological studies from ecology to microbiology. Using binary presence-absence data, we evaluate species co-occurrences that help elucidate relationships among organisms and environments. To summarize similarity between occurrences of species, we routinely use the Jaccard/Tanimoto coefficient, which is the ratio of their intersection to their union. It is natural, then, to identify statistically significant Jaccard/Tanimoto coefficients, which suggest non-random co-occurrences of species. However, statistical hypothesis testing using this similarity coefficient has been seldom used or studied.ResultsWe introduce a hypothesis test for similarity for biological presence-absence data, using the Jaccard/Tanimoto coefficient. Several key improvements are presented including unbiased estimation of expectation and centered Jaccard/Tanimoto coefficients, that account for occurrence probabilities. The exact and asymptotic solutions are derived. To overcome a computational burden due to high-dimensionality, we propose the bootstrap and measurement concentration algorithms to efficiently estimate statistical significance of binary similarity. Comprehensive simulation studies demonstrate that our proposed methods produce accurate p-values and false discovery rates. The proposed estimation methods are orders of magnitude faster than the exact solution, particularly with an increasing dimensionality. We showcase their applications in evaluating co-occurrences of bird species in 28 islands of Vanuatu and fish species in 3347 freshwater habitats in France. The proposed methods are implemented in an open source R package called jaccard (https://cran.r-project.org/package=jaccard).ConclusionWe introduce a suite of statistical methods for the Jaccard/Tanimoto similarity coefficient for binary data, that enable straightforward incorporation of probabilistic measures in analysis for species co-occurrences. Due to their generality, the proposed methods and implementations are applicable to a wide range of binary data arising from genomics, biochemistry, and other areas of science.

Project description:1.Predicting the current and potential distributions of established invasive species is critical for evaluating management options, but methods for differentiating these distributions have received little attention. In particular, there is uncertainty among invasive species managers about the value of information from incidental sightings compared to data from designed field surveys. This study compares the two approaches, and develops a unifying framework, using the case of invasive sambar deer Cervus unicolor in Victoria, Australia.2.We first used 391 incidental sightings of sambar deer and 12 biophysical variables to construct a presence-only habitat suitability model using Maxent. We then used that model to stratify field sampling, with proportionately greater sampling of cells with high predicted habitat suitability. Field sampling, consisting of faecal pellet surveys, sign surveys and camera trapping, was conducted in 80 4-km(2) grid cells. A Bayesian state-space occupancy model was used to predict probability of suitable habitat from the field data.3.The Maxent and occupancy models predicted similar spatial distributions of habitat suitability for sambar deer in Victoria and there was a strong positive correlation between the rankings of cells by the two approaches. The congruence of the two models suggests that any spatial and detection biases in the presence-only data were relatively unimportant in our study.4.We predicted the extent of suitable habitat from the occupancy model using a threshold that gave a false negative error rate of 0·05. The current distribution was the suitable habitat within a kernel that had a 99·5% chance of including the presence locations pooled from incidental sightings and field surveys: the potential distribution was suitable habitat outside that kernel. Several discrete areas of potential distribution were identified as priorities for surveillance monitoring with the aim of detecting and managing incursions of sambar deer.5.Synthesis and applications.Our framework enables managers to robustly estimate the current and potential distributions of established invasive species using either presence-only and/or presence-absence data. Managers can then focus control and/or containment actions within the current distribution and establish surveillance monitoring to detect incursions within the potential distribution.

Dataset Information

A family of functional dissimilarity measures for presence and absence data.

Publications

A family of functional dissimilarity measures for presence and absence data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets