Dataset Information

Estimation of Uncertainties in the Global Distance Test (GDT_TS) for CASP Models.

ABSTRACT: The Critical Assessment of techniques for protein Structure Prediction (or CASP) is a community-wide blind test experiment to reveal the best accomplishments of structure modeling. Assessors have been using the Global Distance Test (GDT_TS) measure to quantify prediction performance since CASP3 in 1998. However, identifying significant score differences between close models is difficult because of the lack of uncertainty estimations for this measure. Here, we utilized the atomic fluctuations caused by structure flexibility to estimate the uncertainty of GDT_TS scores. Structures determined by nuclear magnetic resonance are deposited as ensembles of alternative conformers that reflect the structural flexibility, whereas standard X-ray refinement produces the static structure averaged over time and space for the dynamic ensembles. To recapitulate the structural heterogeneous ensemble in the crystal lattice, we performed time-averaged refinement for X-ray datasets to generate structural ensembles for our GDT_TS uncertainty analysis. Using those generated ensembles, our study demonstrates that the time-averaged refinements produced structure ensembles with better agreement with the experimental datasets than the averaged X-ray structures with B-factors. The uncertainty of the GDT_TS scores, quantified by their standard deviations (SDs), increases for scores lower than 50 and 70, with maximum SDs of 0.3 and 1.23 for X-ray and NMR structures, respectively. We also applied our procedure to the high accuracy version of GDT-based score and produced similar results with slightly higher SDs. To facilitate score comparisons by the community, we developed a user-friendly web server that produces structure ensembles for NMR and X-ray structures and is accessible at http://prodata.swmed.edu/SEnCS. Our work helps to identify the significance of GDT_TS score differences, as well as to provide structure ensembles for estimating SDs of any scores.

SUBMITTER: Li W

PROVIDER: S-EPMC4858170 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Estimation of Uncertainties in the Global Distance Test (GDT_TS) for CASP Models.

Li Wenlin W Schaeffer R Dustin RD Otwinowski Zbyszek Z Grishin Nick V NV

PloS one 20160505 5

The Critical Assessment of techniques for protein Structure Prediction (or CASP) is a community-wide blind test experiment to reveal the best accomplishments of structure modeling. Assessors have been using the Global Distance Test (GDT_TS) measure to quantify prediction performance since CASP3 in 1998. However, identifying significant score differences between close models is difficult because of the lack of uncertainty estimations for this measure. Here, we utilized the atomic fluctuations cau ...[more]

PMID: 27149620

Similar Datasets

Project description:Developing a rigorous understanding of multiple global threats to species persistence requires the use of integrated modeling methods that capture processes which influence species distributions. Species distribution models (SDMs) coupled with population dynamics models can incorporate relationships between changing environments and demographics and are increasingly used to quantify relative extinction risks associated with climate and land-use changes. Despite their appeal, uncertainties associated with complex models can undermine their usefulness for advancing predictive ecology and informing conservation management decisions. We developed a computationally-efficient and freely available tool (GRIP 2.0) that implements and automates a global sensitivity analysis of coupled SDM-population dynamics models for comparing the relative influence of demographic parameters and habitat attributes on predicted extinction risk. Advances over previous global sensitivity analyses include the ability to vary habitat suitability across gradients, as well as habitat amount and configuration of spatially-explicit suitability maps of real and simulated landscapes. Using GRIP 2.0, we carried out a multi-model global sensitivity analysis of a coupled SDM-population dynamics model of whitebark pine (Pinus albicaulis) in Mount Rainier National Park as a case study and quantified the relative influence of input parameters and their interactions on model predictions. Our results differed from the one-at-time analyses used in the original study, and we found that the most influential parameters included the total amount of suitable habitat within the landscape, survival rates, and effects of a prevalent disease, white pine blister rust. Strong interactions between habitat amount and survival rates of older trees suggests the importance of habitat in mediating the negative influences of white pine blister rust. Our results underscore the importance of considering habitat attributes along with demographic parameters in sensitivity routines. GRIP 2.0 is an important decision-support tool that can be used to prioritize research, identify habitat-based thresholds and management intervention points to improve probability of species persistence, and evaluate trade-offs of alternative management options.

Project description:Accurate and precise abundance estimation is vital for informed wildlife conservation and management decision-making. Line transect surveys are a common sampling approach for abundance estimation. Distance sampling is often used to estimate abundance from line transect survey data; however, search encounter spatial capture-recapture can also be used when individuals in the population of interest are identifiable. The search encounter spatial capture-recapture model has rarely been applied, and its performance has not been compared to that of distance sampling. We analyzed simulated datasets to compare the performance of distance sampling and spatial capture-recapture abundance estimators. Additionally, we estimated the abundance of North Atlantic right whales in the southeastern United States with two formulations of each model and compared the estimates. Spatial capture-recapture abundance estimates had lower root mean squared error than distance sampling estimates. Spatial capture-recapture 95% credible intervals for abundance had nominal coverage, i.e., contained the simulating value for abundance in 95% of simulations, whereas distance sampling credible intervals had below nominal coverage. Moreover, North Atlantic right whale abundance estimates from distance sampling models were more sensitive to model specification compared to spatial capture-recapture estimates. When estimating abundance from line transect data, researchers should consider using search encounter spatial capture-recapture when individuals in the population of interest are identifiable, when line transects are surveyed over multiple occasions, when there is imperfect detection of individuals located on the line transect, and when it is safe to assume the population of interest is closed demographically. When line transects are surveyed over multiple occasions, researchers should be aware that individual space use may induce spatial autocorrelation in counts across transects. This is not accounted for in common distance sampling estimators and leads to overly precise abundance estimates.

Dataset Information

Estimation of Uncertainties in the Global Distance Test (GDT_TS) for CASP Models.

Publications

Estimation of Uncertainties in the Global Distance Test (GDT_TS) for CASP Models.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets