Dataset Information

Assessment of ligand-binding residue predictions in CASP9.

ABSTRACT: Interactions between proteins and their ligands play central roles in many physiological processes. The structural details for most of these interactions, however, have not yet been characterized experientially. Therefore, various computational tools have been developed to predict the location of binding sites and the amino acid residues interacting with ligands. In this manuscript, we assess the performance of 33 methods participating in the ligand-binding site prediction category in CASP9. The overall accuracy of ligand-binding site predictions in CASP9 appears rather high (average Matthews correlation coefficient of 0.62 for the 10 top performing groups) and compared to previous experiments more groups performed equally well. However, this should be seen in context of a strong bias in the test data toward easy template-based models. Overall, the top performing methods have converged to a similar approach using ligand-binding site inference from related homologous structures, which limits their applicability for difficult de novo prediction targets. Here, we present the results of the CASP9 assessment of the ligand-binding site category, discuss examples for successful and challenging prediction targets in CASP9, and finally suggest changes in the format of the experiment to overcome the current limitations of the assessment.

SUBMITTER: Schmidt T

PROVIDER: S-EPMC5628505 | biostudies-literature | 2011

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment of ligand-binding residue predictions in CASP9.

Schmidt Tobias T Haas Jürgen J Gallo Cassarino Tiziano T Schwede Torsten T

Proteins 20111011

Interactions between proteins and their ligands play central roles in many physiological processes. The structural details for most of these interactions, however, have not yet been characterized experientially. Therefore, various computational tools have been developed to predict the location of binding sites and the amino acid residues interacting with ligands. In this manuscript, we assess the performance of 33 methods participating in the ligand-binding site prediction category in CASP9. The ...[more]

PMID: 21987472

Similar Datasets

Project description:The estimation of prediction quality is important because without quality measures, it is difficult to determine the usefulness of a prediction. Currently, methods for ligand binding site residue predictions are assessed in the function prediction category of the biennial Critical Assessment of Techniques for Protein Structure Prediction (CASP) experiment, utilizing the Matthews Correlation Coefficient (MCC) and Binding-site Distance Test (BDT) metrics. However, the assessment of ligand binding site predictions using such metrics requires the availability of solved structures with bound ligands. Thus, we have developed a ligand binding site quality assessment tool, FunFOLDQA, which utilizes protein feature analysis to predict ligand binding site quality prior to the experimental solution of the protein structures and their ligand interactions. The FunFOLDQA feature scores were combined using: simple linear combinations, multiple linear regression and a neural network. The neural network produced significantly better results for correlations to both the MCC and BDT scores, according to Kendall's ?, Spearman's ? and Pearson's r correlation coefficients, when tested on both the CASP8 and CASP9 datasets. The neural network also produced the largest Area Under the Curve score (AUC) when Receiver Operator Characteristic (ROC) analysis was undertaken for the CASP8 dataset. Furthermore, the FunFOLDQA algorithm incorporating the neural network, is shown to add value to FunFOLD, when both methods are employed in combination. This results in a statistically significant improvement over all of the best server methods, the FunFOLD method (6.43%), and one of the top manual groups (FN293) tested on the CASP8 dataset. The FunFOLDQA method was also found to be competitive with the top server methods when tested on the CASP9 dataset. To the best of our knowledge, FunFOLDQA is the first attempt to develop a method that can be used to assess ligand binding site prediction quality, in the absence of experimental data.

Project description:A computational docking strategy using multiple conformations of the target protein is discussed and evaluated. A series of low molecular weight, competitive, nonpeptide protein tyrosine phosphatase inhibitors are considered for which the x-ray crystallographic structures in complex with protein tyrosine phosphatase 1B (PTP1B) are known. To obtain a quantitative measure of the impact of conformational changes induced by the inhibitors, these were docked to the active site region of various structures of PTP1B using the docking program FlexX. Firstly, the inhibitors were docked to a PTP1B crystal structure cocrystallized with a hexapeptide. The estimated binding energies for various docking modes as well as the RMS differences between the docked compounds and the crystallographic structure were calculated. In this scenario the estimated binding energies were not predictive inasmuch as docking modes with low estimated binding energies corresponded to relatively large RMS differences when aligned with the corresponding crystal structure. Secondly, the inhibitors were docked to their parent protein structures in which they were cocrystallized. In this case, there was a good correlation between low predicted binding energy and a correct docking mode. Thirdly, to improve the predictability of the docking procedure in the general case, where only a single target protein structure is known, we evaluate an approach which takes possible protein side-chain conformational changes into account. Here, side chains exposed to the active site were considered in their allowed rotamer conformations and protein models containing all possible combinations of side-chain rotamers were generated. To evaluate which of these modeled active sites is the most likely binding site conformation for a certain inhibitor, the inhibitors were docked against all active site models. The receptor rotamer model corresponding to the lowest estimated binding energy is taken as the top candidate. Using this protocol, correct inhibitor binding modes could successfully be discriminated from proposed incorrect binding modes. Moreover, the ranking of the estimated ligand binding energies was in good agreement with experimentally observed binding affinities.

Dataset Information

Assessment of ligand-binding residue predictions in CASP9.

Publications

Assessment of ligand-binding residue predictions in CASP9.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets