Calibration: the Achilles heel of predictive analytics.
Ontology highlight
ABSTRACT: Background
The assessment of calibration performance of risk prediction models based on regression or more flexible machine learning algorithms receives little attention.Main text
Herein, we argue that this needs to change immediately because poorly calibrated algorithms can be misleading and potentially harmful for clinical decision-making. We summarize how to avoid poor calibration at algorithm development and how to assess calibration at algorithm validation, emphasizing balance between model complexity and the available sample size. At external validation, calibration curves require sufficiently large samples. Algorithm updating should be considered for appropriate support of clinical practice.Conclusion
Efforts are required to avoid poor calibration when developing prediction models, to evaluate calibration when validating models, and to update models when indicated. The ultimate aim is to optimize the utility of predictive analytics for shared decision-making and patient counseling.
SUBMITTER: Van Calster B
PROVIDER: S-EPMC6912996 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Guided by evolutionarily signaled vulnerabilities in the structure of SARS-CoV-2, we identify epitopes in free monomers of the spike protein that steer the generation of induced or administered antibodies geared at promoting destabilization of the virus quaternary structure, thereby hampering infectivity.
| S-EPMC7552172 | biostudies-literature
Project description:Mycobacterial pathogens adapt to environmental stresses such as nutrient deprivation by entering a non-replicative antibiotic-tolerant state of persistence. Using a biochemically-validated data-driven approach, we identified an adaptive metabolic network underlying the mycobacterial response to starvation in M. tuberculosis, M. bovis BCG and M. smegmatis. All three species show a strong Mg+2-dependence for surviving complete nutrient deprivation, accompanied by a broad phenotypic antibiotic resistance. Multivariate analysis of RNA-seq, metabolic phenotyping and biochemical data revealed substantial metabolic remodelling involving a shift to triacylglycerol utilization with adaptation to the consequent ketoacidosis by upregulation of cytochrome P450s. Paradoxically, the ketosis-driven P450 upregulation generated substantial levels of reactive oxygen species (ROS) yet conferred hypersensitivity to killing by hydrogen peroxide-induced inactivation of the P450s that reduced ROS levels. This emergent property of starvation-induced mycobacterial persistence represents a potentially exploitable vulnerability.
2016-08-25 | GSE66883 | GEO
Project description:Ovarian cancer is the leading cause of death among gynecological cancers. It exhibits great heterogeneity in tumor biology and treatment response. Germline mutations of DNA repair genes BRCA1/2 are the fundamental defects in hereditary ovarian cancer that expresses a distinct phenotype of high response rates to platinum agents, improved disease-free intervals and survival rates, and high-grade serous histology. The term "BRCAness" describes the phenotypic traits that some sporadic ovarian tumors share with tumors in BRCA1/2 germline mutation carriers and reflects similar causative molecular abnormalities. BRCA pathway studies and molecular profiling reveal BRCA-related defects in almost half of the cases of ovarian cancer. BRCA-like tumors are particularly sensitive to DNA-damaging agents (e.g., platinum agents) because of inadequate BRCA-mediated DNA repair mechanisms, such as nucleotide-excision repair and homologous recombination (HR). Additional inhibition of other DNA repair pathways leads to synthetic lethality in HR-deficient cells; this has been employed in the treatment of BRCA-like ovarian tumors with poly(ADP-ribose) polymerase inhibitors with promising results. This article presents a comprehensive review of the relevant literature on the role of BRCAness in ovarian cancer with respect to BRCA function, methods of BRCA epigenetic defect detection and molecular profiling, and the implications of BRCA dysfunction in the treatment of ovarian cancer.
| S-EPMC3399652 | biostudies-literature
Project description:In this issue, Sun et al. (2008) model the interface between a neutralizing antibody and HIV-1 glycoprotein 41 (gp41) envelope peptide in lipids. This model could help overcome a roadblock in HIV-1 vaccine development.
| S-EPMC2673567 | biostudies-literature
Project description:The networks of blood and lymphatic vessels and of the extracellular matrix and their cellular and structural components, that are collectively termed the tumor microenvironment, are frequently co-opted and shaped by cancer cells to survive, invade, and form distant metastasis. With an enviable capacity to adapt to continually changing environments, cancer represents the epitome of functional chaos, a stark contrast to the hierarchical and organized differentiation processes that dictate the development and life of biological organisms. The consequences of changing landscapes such as hypoxia and acidic extracellular pH in and around tumors create a cascade of changes in multiple pathways and networks that become apparent only several years later as recurrence and metastasis. These molecular and phenotypic changes, several of which are mediated by COX-2, approach the complexities of a "Gordian Knot." We review evidence from our studies and from literature suggesting that cyclooxygenase-2 (COX-2) biology presents a nodal point in cancer biology and an "Achilles heel" of COX-2-dependent tumors.
| S-EPMC3619664 | biostudies-literature
Project description:Human norovirus frequently causes outbreaks of acute gastroenteritis. Although discovered more than five decades ago, antiviral development has, until recently, been hampered by the lack of a reliable human norovirus cell culture system. Nevertheless, a lot of pathogenesis studies were accomplished using murine norovirus (MNV), which can be grown routinely in cell culture. In this study, we analyzed a sizeable library of nanobodies that were raised against the murine norovirus virion with the main purpose of developing nanobody-based inhibitors. We discovered two types of neutralizing nanobodies and analyzed the inhibition mechanisms using X-ray crystallography, cryo-electron microscopy (cryo-EM), and cell culture techniques. The first type bound on the top region of the protruding (P) domain. Interestingly, this nanobody binding region closely overlapped the MNV receptor-binding site and collectively shared numerous P domain-binding residues. In addition, we showed that these nanobodies competed with the soluble receptor, and this action blocked virion attachment to cultured cells. The second type bound at a dimeric interface on the lower side of the P dimer. We discovered that these nanobodies disrupted a structural change in the capsid associated with binding cofactors (i.e., metal cations/bile acid). Indeed, we found that capsids underwent major conformational changes following addition of Mg2+ or Ca2+ Ultimately, these nanobodies directly obstructed a structural modification reserved for a postreceptor attachment stage. Altogether, our new data show that nanobody-based inhibition could occur by blocking functional and structural capsid properties.IMPORTANCE This research discovered and analyzed two different types of MNV-neutralizing nanobodies. The top-binding nanobodies sterically inhibited the receptor-binding site, whereas the dimeric-binding nanobodies interfered with a structural modification associated with cofactor binding. Moreover, we found that the capsid contained a number of vulnerable regions that were essential for viral replication. In fact, the capsid appeared to be organized in a state of flux, which could be important for cofactor/receptor-binding functions. Blocking these capsid-binding events with nanobodies directly inhibited essential capsid functions. Moreover, a number of MNV-specific nanobody binding epitopes were comparable to human norovirus-specific nanobody inhibitors. Therefore, this additional structural and inhibition information could be further exploited in the development of human norovirus antivirals.
| S-EPMC7307151 | biostudies-literature
Project description:Widespread antimicrobial resistance among bacterial pathogens is a serious threat to public health. Thus, identification of new targets and development of new antibacterial agents are urgently needed. Although cell division is a major driver of bacterial colonization and pathogenesis, its targeting with antibacterial compounds is still in its infancy. FtsZ, a bacterial cytoskeletal homolog of eukaryotic tubulin, plays a highly conserved and foundational role in cell division and has been the primary focus of research on small molecule cell division inhibitors. FtsZ contains two drug-binding pockets: the GTP binding site situated at the interface between polymeric subunits, and the inter-domain cleft (IDC), located between the N-terminal and C-terminal segments of the core globular domain of FtsZ. The majority of anti-FtsZ molecules bind to the IDC. Compounds that bind instead to the GTP binding site are much less useful as potential antimicrobial therapeutics because they are often cytotoxic to mammalian cells, due to the high sequence similarity between the GTP binding sites of FtsZ and tubulin. Fortunately, the IDC has much less sequence and structural similarity with tubulin, making it a better potential target for drugs that are less toxic to humans. Over the last decade, a large number of natural and synthetic IDC inhibitors have been identified. Here we outline the molecular structure of IDC in detail and discuss how it has become a crucial target for broad spectrum and species-specific antibacterial agents. We also outline the drugs that bind to the IDC and their modes of action.
| S-EPMC8456036 | biostudies-literature
Project description:IntroductionThe importance of management to the implementation of integrated care is recognised in evidence and practice. Despite this recognition, there is a lack of clarity about what 'good' management of integrated care looks like, if the competences are different to management for 'traditional' care, and how such competences can be acquired.Theory and methodsThis exploratory study is based on qualitative interviews with participants with extensive experience of implementing integrated care in senior professional, research, administrative and/or policy roles. It conceptualises management as working at 'strategic' and 'operational' levels.ResultsManagement of integrated care was seen to require an ability to create networks across professions and organisations, to be comfortable with distributing responsibilities, and to thoroughly understand the wider system. Competences to support these new ways of working included an understanding of how to implement people-centredness, to have courage to challenge the status quo, and to demonstrate humility to learn from others. Structured development opportunities for managers were lacking, but seen as vital for the sustainability of change.Discussion and conclusionManagement for integrated care remains an underdeveloped concept and practice. A first formulation of the competences necessary was achieved, but more work is urgently required to understand how to better prepare and support managers to achieve necessary changes in practice and culture.
| S-EPMC7047758 | biostudies-literature
Project description:Picornaviruses are small, icosahedral, nonenveloped, positive-sense, single-stranded RNA viruses that form one of the largest and most important viral families. Numerous Picornaviridae members pose serious health or agricultural threats, causing diseases such as poliomyelitis, hepatitis A, or foot-and-mouth disease. The antigenic characterization of picornavirus capsids plays an important role in understanding the mechanism of viral neutralization and the conformational changes associated with genome release, and it can point to regions which can be targeted by small-molecule compounds to be developed as antiviral inhibitors. In a recent study, Cao and colleagues applied this strategy to hepatitis A virus (HAV) and used cryo-electron microscopy (cryo-EM) to characterize a well-conserved antigenic site recognized by several monoclonal antibodies. They further used computational approaches to identify a small-molecule drug with a strong inhibitory effect on cell attachment.
| S-EPMC6490930 | biostudies-literature
Project description:Emerging and re-emerging infectious diseases and zoonoses indicate the importance of the One Health (OH) approach for early warning. At present, even when surveillance data are available, they are infrequently timeously shared between the health sectors. In the context of the MediLabSecure (MLS) Project, we investigated the collection of a set of surveillance indicators able to provide data for the implementation of integrated early warning systems in the 22 MLS countries of the Mediterranean, Black Sea and Sahel regions. We used an online questionnaire (covering vector, human, and animal sectors), focusing on seven relevant arboviruses, that was submitted to 110 officially appointed experts. Results showed that West Nile virus was perceived as the most relevant zoonotic pathogen, while Dengue virus was the most relevant non-zoonotic pathogen in the study area. Data collection of early warning indicators is in place at a different level for all the investigated pathogens and in almost all the MLS Countries. Further assessments on the reliability of the collection in place and on the feasibility of piloting an integrated early warning system for arbovirus could verify if integrated early warning really represents the Achilles' heel of OH.
| S-EPMC7022449 | biostudies-literature