Dataset Information

Are geometric morphometric analyses replicable? Evaluating landmark measurement error and its impact on extant and fossil Microtus classification.

ABSTRACT: Geometric morphometric analyses are frequently employed to quantify biological shape and shape variation. Despite the popularity of this technique, quantification of measurement error in geometric morphometric datasets and its impact on statistical results is seldom assessed in the literature. Here, we evaluate error on 2D landmark coordinate configurations of the lower first molar of five North American Microtus (vole) species. We acquired data from the same specimens several times to quantify error from four data acquisition sources: specimen presentation, imaging devices, interobserver variation, and intraobserver variation. We then evaluated the impact of those errors on linear discriminant analysis-based classifications of the five species using recent specimens of known species affinity and fossil specimens of unknown species affinity. Results indicate that data acquisition error can be substantial, sometimes explaining >30% of the total variation among datasets. Comparisons of datasets digitized by different individuals exhibit the greatest discrepancies in landmark precision, and comparison of datasets photographed from different presentation angles yields the greatest discrepancies in species classification results. All error sources impact statistical classification to some extent. For example, no two landmark dataset replicates exhibit the same predicted group memberships of recent or fossil specimens. Our findings emphasize the need to mitigate error as much as possible during geometric morphometric data collection. Though the impact of measurement error on statistical fidelity is likely analysis-specific, we recommend that all geometric morphometric studies standardize specimen imaging equipment, specimen presentations (if analyses are 2D), and landmark digitizers to reduce error and subsequent analytical misinterpretations.

SUBMITTER: Fox NS

PROVIDER: S-EPMC7140992 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Are geometric morphometric analyses replicable? Evaluating landmark measurement error and its impact on extant and fossil <i>Microtus</i> classification.

Fox Nathaniel S NS Veneracion Joseph J JJ Blois Jessica L JL

Ecology and evolution 20200313 7

Geometric morphometric analyses are frequently employed to quantify biological shape and shape variation. Despite the popularity of this technique, quantification of measurement error in geometric morphometric datasets and its impact on statistical results is seldom assessed in the literature. Here, we evaluate error on 2D landmark coordinate configurations of the lower first molar of five North American <i>Microtus</i> (vole) species. We acquired data from the same specimens several times to qu ...[more]

PMID: 32273985

Similar Datasets

Project description:Species of terebratulide brachiopods have been largely characterized qualitatively on the basis of morphology. Furthermore, species-level morphological variability has rarely been analyzed within a quantitative framework. The objective of our research is to quantify morphological variation to test the validity of extant named species of terebratulide brachiopods, focusing on the lophophore-supporting structures-the "long loops." Long loops are the most distinctive and complex morphological feature in terebratellidine brachiopods and are considered to be phylogenetically and taxonomically informative. We studied eight species with problematic species identities in three genera distributed in the North Pacific: Laqueus, Terebratalia, and Dallinella. Given how geometrically complex long loops are, we generated 3D models from computed tomography (CT) scans of specimens of these eight species and analyzed them using 3D geometric morphometrics. Our goal was to determine ranges of variation and to test whether species are clearly distinguishable from one another in morphospace and statistically. Previous studies have suggested that some species might be overly split and are indistinguishable. Our results show that these extant species of terebratellidines can be reliably distinguished on the basis of quantitative loop morphometrics. Using 3D geometric morphometric methods, we demonstrate the utility of CT beyond purely descriptive imaging purposes in testing the morphometric validity of named species. It is crucial to treat species described and named from qualitative morphology as working hypotheses to be tested; many macroevolutionary studies depend upon the accurate assessment of species in order to identify and seek to explain macroevolutionary patterns. Our results provide quantitative documentation of the distinction of these species and thus engender greater confidence in their use to characterize macroevolutionary patterns among extant terebratellidine brachiopods. These methods, however, require further testing in extinct terebratellidines, which only rarely preserve the delicate long loop in three dimensions. In addition, molecular analyses of extant terebratellidines will test the species delimitations supported by the morphometric analyses presented in this study. [Species determination; morphological variability; 3D geometric morphometrics; terebratulide brachiopods; long loops.].

Project description:Geometric morphometrics is routinely used in ecology and evolution and morphometric datasets are increasingly shared among researchers, allowing for more comprehensive studies and higher statistical power (as a consequence of increased sample size). However, sharing of morphometric data opens up the question of how much nonbiologically relevant variation (i.e., measurement error) is introduced in the resulting datasets and how this variation affects analyses. We perform a set of analyses based on an empirical 3D geometric morphometric dataset. In particular, we quantify the amount of error associated with combining data from multiple devices and digitized by multiple operators and test for the presence of bias. We also extend these analyses to a dataset obtained with a recently developed automated method, which does not require human-digitized landmarks. Further, we analyze how measurement error affects estimates of phylogenetic signal and how its effect compares with the effect of phylogenetic uncertainty. We show that measurement error can be substantial when combining surface models produced by different devices and even more among landmarks digitized by different operators. We also document the presence of small, but significant, amounts of nonrandom error (i.e., bias). Measurement error is heavily reduced by excluding landmarks that are difficult to digitize. The automated method we tested had low levels of error, if used in combination with a procedure for dimensionality reduction. Estimates of phylogenetic signal can be more affected by measurement error than by phylogenetic uncertainty. Our results generally highlight the importance of landmark choice and the usefulness of estimating measurement error. Further, measurement error may limit comparisons of estimates of phylogenetic signal across studies if these have been performed using different devices or by different operators. Finally, we also show how widely held assumptions do not always hold true, particularly that measurement error affects inference more at a shallower phylogenetic scale and that automated methods perform worse than human digitization.

Project description:Morphometric analysis of anatomical landmarks allows researchers to identify specific morphological differences between natural populations or experimental groups, but manually identifying landmarks is time-consuming. We compare manually and automatically generated adult mouse skull landmarks and subsequent morphometric analyses to elucidate how switching from manual to automated landmarking will impact morphometric analysis results for large mouse (Mus musculus) samples (n = 1205) that represent a wide range of 'normal' phenotypic variation (62 genotypes). Other studies have suggested that the use of automated landmarking methods is feasible, but this study is the first to compare the utility of current automated approaches to manual landmarking for a large dataset that allows the quantification of intra- and inter-strain variation. With this unique sample, we investigated how switching to a non-linear image registration-based automated landmarking method impacts estimated differences in genotype mean shape and shape variance-covariance structure. In addition, we tested whether an initial registration of specimen images to genotype-specific averages improves automatic landmark identification accuracy. Our results indicated that automated landmark placement was significantly different than manual landmark placement but that estimated skull shape covariation was correlated across methods. The addition of a preliminary genotype-specific registration step as part of a two-level procedure did not substantially improve on the accuracy of one-level automatic landmark placement. The landmarks with the lowest automatic landmark accuracy are found in locations with poor image registration alignment. The most serious outliers within morphometric analysis of automated landmarks displayed instances of stochastic image registration error that are likely representative of errors common when applying image registration methods to micro-computed tomography datasets that were initially collected with manual landmarking in mind. Additional efforts during specimen preparation and image acquisition can help reduce the number of registration errors and improve registration results. A reduction in skull shape variance estimates were noted for automated landmarking methods compared with manual landmarking. This partially reflects an underestimation of more extreme genotype shapes and loss of biological signal, but largely represents the fact that automated methods do not suffer from intra-observer landmarking error. For appropriate samples and research questions, our image registration-based automated landmarking method can eliminate the time required for manual landmarking and have a similar power to identify shape differences between inbred mouse genotypes.

Dataset Information

Are geometric morphometric analyses replicable? Evaluating landmark measurement error and its impact on extant and fossil Microtus classification.

Publications

Are geometric morphometric analyses replicable? Evaluating landmark measurement error and its impact on extant and fossil <i>Microtus</i> classification.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets