Dataset Information

Introducing "best single template" models as reference baseline for the Continuous Automated Model Evaluation (CAMEO).

ABSTRACT: Critical blind assessment of structure prediction techniques is crucial for the scientific community to establish the state of the art, identify bottlenecks, and guide future developments. In Critical Assessment of Techniques in Structure Prediction (CASP), human experts assess the performance of participating methods in relation to the difficulty of the prediction task in a biennial experiment on approximately 100 targets. Yet, the development of automated computational modeling methods requires more frequent evaluation cycles and larger sets of data. The "Continuous Automated Model EvaluatiOn (CAMEO)" platform complements CASP by conducting fully automated blind prediction evaluations based on the weekly pre-release of sequences of those structures, which are going to be published in the next release of the Protein Data Bank (PDB). Each week, CAMEO publishes benchmarking results for predictions corresponding to a set of about 20 targets collected during a 4-day prediction window. CAMEO benchmarking data are generated consistently for all methods at the same point in time, enabling developers to cross-validate their method's performance, and referring to their results in publications. Many successful participants of CASP have used CAMEO-either by directly benchmarking their methods within the system or by comparing their own performance to CAMEO reference data. CAMEO offers a variety of scores reflecting different aspects of structure modeling, for example, binding site accuracy, homo-oligomer interface quality, or accuracy of local model confidence estimates. By introducing the "bestSingleTemplate" method based on structure superpositions as a reference for the accuracy of 3D modeling predictions, CAMEO facilitates objective comparison of techniques and fosters the development of advanced methods.

SUBMITTER: Haas J

PROVIDER: S-EPMC8196401 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundLongitudinal migraine studies have rarely assessed headache frequency and disability variation over a year.MethodsThe Chronic Migraine Epidemiology and Outcomes (CaMEO) Study is a cross-sectional and longitudinal Internet study designed to characterize the course of episodic migraine (EM) and chronic migraine (CM). Participants were recruited from a Web-panel using quota sampling in an attempt to obtain a sample demographically similar to the US population. Participants who passed the screener were assessed every three months with the Core (baseline, six, and 12 months) and Snapshot (months three and nine) modules, which assessed headache frequency, headache-related disability, treatments, and treatment satisfaction. The Core also assessed resource use, health-related quality of life, and other features. One-time cross-sectional modules measured family burden, barriers to medical care, and comorbidities/endophenotypes.ResultsOf 489,537 invitees, we obtained 58,418 (11.9%) usable returns including 16,789 individuals who met ICHD-3 beta migraine criteria (EM (<15 headache days/mo): n = 15,313 (91.2%); CM (? 15 headache days/mo): n = 1476 (8.8%)). At baseline, all qualified respondents (n = 16,789) completed the Screener, Core, and Barriers to Care modules. Subsequent modules showed some attrition (Comorbidities/Endophenotypes, n = 12,810; Family Burden (Proband), n = 13,064; Family Burden (Partner), n = 4022; Family Burden (Child), n = 2140; Snapshot (three months), n = 9741; Core (six months), n = 7517; Snapshot (nine months), n = 6362; Core (12 months), n = 5915). A total of 3513 respondents (21.0%) completed all modules, and 3626 (EM: n = 3303 (21.6%); CM: n = 323 (21.9%)) completed all longitudinal assessments.ConclusionsThe CaMEO Study provides cross-sectional and longitudinal data that will contribute to our understanding of the course of migraine over one year and quantify variations in headache frequency, headache-related disability, comorbidities, treatments, and familial impact.

Dataset Information

Introducing "best single template" models as reference baseline for the Continuous Automated Model Evaluation (CAMEO).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets