CASP9 results compared to those of previous CASP experiments.
Ontology highlight
ABSTRACT:
SUBMITTER: Kryshtafovych A
PROVIDER: S-EPMC4180080 | biostudies-literature | 2011
REPOSITORIES: biostudies-literature
Publications
CASP9 results compared to those of previous CASP experiments.
Kryshtafovych Andriy A Fidelis Krzysztof K Moult John J
Proteins 20111014
The quality of structure models submitted to CASP9 is analyzed in the context of previous CASPs. Comparison methods are similar to those used in previous articles in this series, with the addition of new methods looking at model quality in regions not covered by a single best structural template, alignment accuracy, and progress for template-free models. Progress in this CASP was again modest and statistically hard to validate. Nevertheless, there are several positive trends. There is an indicat ...[more]
Similar Datasets
Project description:We compare results of the community efforts in modeling protein structures in the tenth CASP experiment, with those in earlier CASPs particularly in CASP5, a decade ago. There is a substantial improvement in template based model accuracy as reflected in more successful modeling of regions of structure not easily derived from a single experimental structure template, most likely reflecting intensive work within the modeling community in developing methods that make use of multiple templates, as well as the increased number of experimental structures available. Deriving structural information not obvious from a template is the most demanding as well as one of the most useful tasks that modeling can perform. Thus this is gratifying progress. By contrast, overall backbone accuracy of models appears little changed in the last decade. This puzzling result is explained by two factors--increased database size in some ways makes it harder to choose the best available templates, and the increased intrinsic difficulty of CASP targets as experimental work has progressed to larger and more unusual structures. There is no detectable recent improvement in template-free modeling, but again, this may reflect the changing nature of CASP targets.
| S-EPMC4180100 | biostudies-literature
Project description:The quality of structure models submitted to CASP8 is analyzed in the context of previous CASPs. To compare models from the latest experiment with their predecessors, we use the approaches consistent with the previous articles in this series. Using the basic evaluation measures accepted in CASP, there were no noticeable advances in the quality of the methods in any of the target difficulty categories. At the same time, there were three positive developments: (1) for set of the best models on each target, CASP8 registered the highest number of cases from all CASPs where alignment accuracy exceeded the maximum possible from the best template; (2) modeling accuracy of regions not present in the best template has improved; and (3) the loss in modeling quality from selection of nonoptimal models as the best ones submitted on the target has decreased.
| S-EPMC5479686 | biostudies-literature
Project description:BackgroundRecently, significant progress has been made in the field of protein structure prediction by the application of artificial intelligence techniques, as shown by the results of the CASP13 and CASP14 (Critical Assessment of Structure Prediction) competition. However, the question of the mechanism behind the protein folding process itself remains unanswered. Correctly predicting the structure also does not solve the problem of, for example, amyloid proteins, where a polypeptide chain with an unaltered sequence adopts a different 3D structure.ResultsThis work was an attempt at explaining the structural variation by considering the contribution of the environment to protein structuring. The application of the fuzzy oil drop (FOD) model to assess the validity of the selected models provided in the CASP13, CASP14 and CASP15 projects reveals the need for an environmental factor to determine the 3D structure of proteins. Consideration of the external force field in the form of polar water (Fuzzy Oil Drop) and a version modified by the presence of the hydrophobic compounds, FOD-M (FOD-Modified) reveals that the protein folding process is environmentally dependent. An analysis of selected models from the CASP competitions indicates the need for structure prediction as dependent on the consideration of the protein folding environment.ConclusionsThe conditions governed by the environment direct the protein folding process occurring in a certain environment. Therefore, the variation of the external force field should be taken into account in the models used in protein structure prediction.
| S-EPMC10638730 | biostudies-literature
Project description:The Critical assessment of protein structure prediction round 9 (CASP9) aimed to evaluate predictions for 129 experimentally determined protein structures. To assess tertiary structure predictions, these target structures were divided into domain-based evaluation units that were then classified into two assessment categories: template based modeling (TBM) and template free modeling (FM). CASP9 targets were split into domains of structurally compact evolutionary modules. For the targets with more than one defined domain, the decision to split structures into domains for evaluation was based on server performance. Target domains were categorized based on their evolutionary relatedness to existing templates as well as their difficulty levels indicated by server performance. Those target domains with sequence-related templates and high server prediction performance were classified as TMB, whereas those targets without identifiable templates and low server performance were classified as FM. However, using these generalizations for classification resulted in a blurred boundary between CASP9 assessment categories. Thus, the FM category included those domains without sequence detectable templates (25 target domains) as well as some domains with difficult to detect templates whose predictions were as poor as those without templates (five target domains). Several interesting examples are discussed, including targets with sequence related templates that exhibit unusual structural differences, targets with homologous or analogous structure templates that are not detectable by sequence, and targets with new folds.
| S-EPMC3226894 | biostudies-literature
Project description:Zaire Ebolavirus (ZEBOV) continues to pose a significant threat to human health as highlighted by the recent epidemic that originated in West Africa and the ongoing outbreak in the Democratic Republic of the Congo. Although the ZEBOV variant responsible for this epidemic (Makona) shares significant genetic similarity with previously identified variants (Kikwit and Mayinga), recent reports suggest slower disease progression in nonhuman primates. However, the pathogenesis caused by the new variant is not fully understood. We present the first comprehensive approach in understanding ZEBOV-Makona pathogenesis in cynomolgus macaques by measuring changes in immune cell frequencies, plasma levels of immune mediators, and differentially expressed genes (DEGs) within whole blood (WB) and peripheral blood mononuclear cells (PBMC). Our combined approach revealed a link between: 1) increased interferon-stimulated gene expression, IFN? levels, and activated plasmacytoid dendritic cells; 2) higher proinflammatory gene expression, cytokine and chemokine levels, and non-classical monocytes; 3) gene signature of leukocyte activation and increased granulocytes; and 4) decreased expression of lymphocyte related genes and lymphopenia. In addition, our data strongly indicate delayed disease progression as well as limited overlap (~30%) in host transcriptome changes following ZEBOV-Makona infection compared to ZEBOV-Kikwit. These observations provide novel insight into the molecular mechanisms of ZEBOV-Makona pathogenesis.
| S-EPMC5574898 | biostudies-literature
Project description:BackgroundBoth raloxifene and bisphosphonates are indicated for the prevention and treatment of postmenopausal osteoporosis, however these medications have different efficacy and safety profiles. It is plausible that physicians would prescribe these agents to optimize the benefit/risk profile for individual patients. The objective of this study was to compare demographic and clinical characteristics of patients initiating raloxifene with those of patients initiating bisphosphonates for the prevention and treatment of osteoporosis.MethodsThis study was conducted using a retrospective cohort design. Female beneficiaries (45 years and older) with at least one claim for raloxifene or a bisphosphonate in 2003 through 2005 and continuous enrollment in the previous 12 months and subsequent 6 months were identified using a collection of large national commercial, Medicare supplemental, and Medicaid administrative claims databases (MarketScan). Patients were divided into two cohorts, a combined commercial/Medicare cohort and a Medicaid cohort. Within each cohort, characteristics (demographic, clinical, and resource utilization) of patients initiating raloxifene were compared to those of patients initiating bisphosphonate therapy. Group comparisons were made using chi-square tests for proportions of categorical measures and Wilcoxon rank-sum tests for continuous variables. Logistic regression was used to simultaneously examine factors independently associated with initiation of raloxifene versus a bisphosphonate.ResultsWithin both the commercial/Medicare and Medicaid cohorts, raloxifene patients were younger, had fewer comorbid conditions, and fewer pre-existing fractures than bisphosphonate patients. Raloxifene patients in both cohorts were less likely to have had a bone mineral density (BMD) screening in the previous year than were bisphosphonate patients, and were also more likely to have used estrogen or estrogen/progestin therapy in the previous 12 months. These differences remained statistically significant in the multivariate model.ConclusionIn this sample of patients enrolled in commercial, Medicare, and Medicaid plans, patients who initiated raloxifene treatment differed from those initiating bisphosphonates. Raloxifene patients were younger, had better overall health status and appeared to be less likely to have risk factors for new osteoporotic fractures than bisphosphonate patients. Differences in the clinical profiles of these agents may impact prescribing decisions. Investigators using observational data to make comparisons of treatment outcomes associated with these medications should take these important differences in patient characteristics into consideration.
| S-EPMC2642779 | biostudies-literature
Project description:Protein target structures for the Critical Assessment of Structure Prediction round 11 (CASP11) and CASP ROLL were split into domains and classified into categories suitable for assessment of template-based modeling (TBM) and free modeling (FM) based on their evolutionary relatedness to existing structures classified by the Evolutionary Classification of Protein Domains (ECOD) database. First, target structures were divided into domain-based evaluation units. Target splits were based on the domain organization of available templates as well as the performance of servers on whole targets compared to split target domains. Second, evaluation units were classified into TBM and FM categories using a combination of measures that evaluate prediction quality and template detectability. Generally, target domains with sequence-related templates and good server prediction performance were classified as TBM, whereas targets without sequence-identifiable templates and low server performance were classified as FM. As in previous CASP experiments, the boundaries for classification were blurred due to the presence of significant insertions and deteriorations in the targets with respect to homologous templates, as well as the presence of templates with partial coverage of new folds. The FM category included 45 target domains, which represents an unprecedented number of difficult CASP targets provided for modeling. Proteins 2016; 84(Suppl 1):20-33. © 2016 Wiley Periodicals, Inc.
| S-EPMC4940306 | biostudies-literature
Project description:Lack of stable three-dimensional structure, or intrinsic disorder, is a common phenomenon in proteins. Naturally, unstructured regions are proven to be essential for carrying function by many proteins, and therefore identification of such regions is an important issue. CASP has been assessing the state of the art in predicting disorder regions from amino acid sequence since 2002. Here, we present the results of the evaluation of the disorder predictions submitted to CASP9. The assessment is based on the evaluation measures and procedures used in previous CASPs. The balanced accuracy and the Matthews correlation coefficient were chosen as basic measures for evaluating the correctness of binary classifications. The area under the receiver operating characteristic curve was the measure of choice for evaluating probability-based predictions of disorder. The CASP9 methods are shown to perform slightly better than the CASP7 methods but not better than the methods in CASP8. It was also shown that capability of most CASP9 methods to predict disorder decreases with increasing minimum disorder segment length.
| S-EPMC3212657 | biostudies-literature
Project description:Purpose. To present the psychometric properties of a new measure of quality of life in older age, the Older People's Quality of Life (OPQOL) Questionnaire, compared with the CAPSE-19 and the WHOQOL-OLD. Design and Methods. The vehicle was three national population surveys of older people living at home in Britain, including a survey of ethnically diverse older people. Results. The OPQOL had acceptable levels of reliability and validity in British population samples of older people, but more modest in the ethnically diverse population sample. The CASP-19 and WHOQOL-OLD had acceptable levels of reliability and validity in the British population sample, but not in the ethnically diverse sample. Implications. The OPQOL has potential for use as a multidimensional population surveillance instrument for use with older populations, or as an outcome measure of multisector policy. Its strengths are that its development was embedded firmly in the perspectives of older people, integrated with theory.
| S-EPMC2819744 | biostudies-literature
Project description:CASP has been assessing the state of the art in the a priori estimation of accuracy of protein structure prediction since 2006. The inclusion of model quality assessment category in CASP contributed to a rapid development of methods in this area. In the last experiment, 46 quality assessment groups tested their approaches to estimate the accuracy of protein models as a whole and/or on a per-residue basis. We assessed the performance of these methods predominantly on the basis of the correlation between the predicted and observed quality of the models on both global and local scales. The ability of the methods to identify the models closest to the best one, to differentiate between good and bad models, and to identify well modeled regions was also analyzed. Our evaluations demonstrate that even though global quality assessment methods seem to approach perfection point (weighted average per-target Pearson's correlation coefficients are as high as 0.97 for the best groups), there is still room for improvement. First, all top-performing methods use consensus approaches to generate quality estimates, and this strategy has its own limitations. Second, the methods that are based on the analysis of individual models lag far behind clustering techniques and need a boost in performance. The methods for estimating per-residue accuracy of models are less accurate than global quality assessment methods, with an average weighted per-model correlation coefficient in the range of 0.63-0.72 for the best 10 groups.
| S-EPMC3226935 | biostudies-literature