Dataset Information

Mahalanobis distances for ecological niche modelling and outlier detection: implications of sample size, error, and bias for selecting and parameterising a multivariate location and scatter method.

ABSTRACT: The Mahalanobis distance is a statistical technique that has been used in statistics and data science for data classification and outlier detection, and in ecology to quantify species-environment relationships in habitat and ecological niche models. Mahalanobis distances are based on the location and scatter of a multivariate normal distribution, and can measure how distant any point in space is from the centre of this kind of distribution. Three different methods for calculating the multivariate location and scatter are commonly used: the sample mean and variance-covariance, the minimum covariance determinant, and the minimum volume ellipsoid. The minimum covariance determinant and minimum volume ellipsoid were developed to be robust to outliers by minimising the multivariate location and scatter for a subset of the full sample, with the proportion of the full sample forming the subset being controlled by a user-defined parameter. This outlier robustness means the minimum covariance determinant and the minimum volume ellipsoid are highly relevant for ecological niche analyses, which are usually based on natural history observations that are likely to contain errors. However, natural history observations will also contain extreme bias, to which the minimum covariance determinant and the minimum volume ellipsoid will also be sensitive. To provide guidance for selecting and parameterising a multivariate location and scatter method, a series of virtual ecological niche modelling experiments were conducted to demonstrate the performance of each multivariate location and scatter method under different levels of sample size, errors, and bias. The results show that there is no optimal modelling approach, and that choices need to be made based on the individual data and question. The sample mean and variance-covariance method will perform best on very small sample sizes if the data are free of error and bias. At larger sample sizes the minimum covariance determinant and minimum volume ellipsoid methods perform as well or better, but only if they are appropriately parameterised. Modellers who are more concerned about the prevalence of errors should retain a smaller proportion of the full data set, while modellers more concerned about the prevalence of bias should retain a larger proportion of the full data set. I conclude that Mahalanobis distances are a useful niche modelling technique, but only for questions relating to the fundamental niche of a species where the assumption of multivariate normality is reasonable. Users of the minimum covariance determinant and minimum volume ellipsoid methods must also clearly report their parameterisations so that the results can be interpreted correctly.

SUBMITTER: Etherington TR

PROVIDER: S-EPMC8121071 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundOutliers, data points that significantly deviate from the norm, can have a substantial impact on statistical inference and provide valuable insights in data analysis. Multiple methods have been developed for outlier detection, however, almost all available approaches fail to consider the spatial dependence and heterogeneity in spatial data. Spatial data has diverse formats and semantics, requiring specialized outlier detection methodology to handle these unique properties. For now, there is limited research exists on robust spatial outlier detection methods designed specifically under the spatial error model (SEM) structure.MethodWe propose the Spatial-Θ-Iterative Procedure for Outlier Detection (Spatial-Θ-IPOD), which utilizes a mean-shift vector to identify outliers within the SEM. Our method enables an effective detection of spatial outliers while also providing robust coefficient estimates. To assess the performance of our approach, we conducted extensive simulations and applied it to a real-world empirical study using life expectancy data from multiple countries.ResultsSimulation results showed that the masking and JD (Joint Detection) indicators of our Spatial-Θ-IPOD method outperformed several commonly used methods, even in high-dimensional scenarios, demonstrating stable performance. Conversely, the Θ-IPOD method proved to be ineffective in detecting outliers when spatial correlation was present. Moreover, our model successfully provided reliable coefficient estimation alongside outlier detection. The proposed method consistently outperformed other models (both robust and non-robust) in most cases. In the empirical study, our proposed model successfully detected outliers and provided valuable insights in the modeling process.ConclusionsOur proposed Spatial-Θ-IPOD offers an effective solution for detecting spatial outliers for SEM while providing robust coefficient estimates. Notably, our approach showcases its relative superiority even in the presence of high leverage points. By successfully identifying outliers, our method enhances the overall understanding of the data and provides valuable insights for further analysis.

Project description:Quantitative MRI methods have recently gained extensive interest and are seeing substantial developments; however, their application in single patient vs control group comparisons is often limited by inherent statistical difficulties. One such application is detecting malformations of cortical development (MCDs) behind drug resistant epilepsies, a task that, especially when based solely on conventional MR images, may represent a serious challenge. We aimed to develop a novel straightforward voxel-wise evaluation method based on the Mahalanobis-distance, combining quantitative MRI data into a multidimensional parameter space and detecting lesion voxels as outliers. Simulations with standard multivariate Gaussian distribution and resampled DTI-eigenvalue data of 45 healthy control subjects determined the optimal critical value, cluster size threshold, and the expectable lesion detection performance through ROC-analyses. To reduce the effect of false positives emanating from registration artefacts and gyrification differences, an automatic classification method was applied, fine-tuned using a leave-one-out strategy based on diffusion and T1-weighted data of the controls. DWI processing, including thorough corrections and robust tensor fitting was performed with ExploreDTI, spatial coregistration was achieved with the DARTEL tools of SPM12. Additional to simulations, clusters of outlying diffusion profile, concordant with neuroradiological evaluation and independent calculations with the MAP07 toolbox were identified in 12 cases of a 13 patient example population with various types of MCDs. The multidimensional approach proved sufficiently sensitive in pinpointing regions of abnormal tissue microstructure using DTI data both in simulations and in the heterogeneous example population. Inherent limitations posed by registration artefacts, age-related differences, and the different or mixed pathologies limit the generalization of specificity estimation. Nevertheless, the proposed statistical method may aid the everyday examination of individual subjects, ever so more upon extending the framework with quantitative information from other modalities, e.g. susceptibility mapping, relaxometry, or perfusion.

Dataset Information

Mahalanobis distances for ecological niche modelling and outlier detection: implications of sample size, error, and bias for selecting and parameterising a multivariate location and scatter method.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets