Calibration: the Achilles heel of predictive analytics.
Ontology highlight
ABSTRACT: Background
The assessment of calibration performance of risk prediction models based on regression or more flexible machine learning algorithms receives little attention.Main text
Herein, we argue that this needs to change immediately because poorly calibrated algorithms can be misleading and potentially harmful for clinical decision-making. We summarize how to avoid poor calibration at algorithm development and how to assess calibration at algorithm validation, emphasizing balance between model complexity and the available sample size. At external validation, calibration curves require sufficiently large samples. Algorithm updating should be considered for appropriate support of clinical practice.Conclusion
Efforts are required to avoid poor calibration when developing prediction models, to evaluate calibration when validating models, and to update models when indicated. The ultimate aim is to optimize the utility of predictive analytics for shared decision-making and patient counseling.
SUBMITTER: Van Calster B
PROVIDER: S-EPMC6912996 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundIn recent years, the incidence of thyroid nodules has increased significantly. There are various ways to treat thyroid nodules, and ablation therapy is one of the important ways to treat thyroid nodules. However, there are many complications and deficiencies in the current ablation treatment of thyroid nodules, especially the incomplete ablation of thyroid cancer nodules, which limits the further application of ablation technology. In this paper, we report two cases of incomplete ablation of thyroid nodules, one of which underwent surgical treatment due to anxiety after ablation, and the postoperative pathology confirmed that there was still residual papillary thyroid carcinoma, and the other patient underwent an operation after ablation, but visited our medical institution again due to cervical lymph node metastasis in a short period of time, and after radical cervical lymph node dissection, pathology confirmed multiple cervical lymph node metastasis. Radionuclide therapy was performed after surgery, and two patients are currently receiving endocrine suppression therapy, and their condition is stable with no signs of recurrence.ConclusionThe incomplete ablation of thyroid cancer nodules limits the development of ablation therapy, making ablation treatment a double-edged sword. Guidelines and expert consensus can guide their development, but they need to evolve with the times, and a multidisciplinary diagnostic team can help screen the most suitable patients. Only by using this technology more standardly, using the most appropriate technology, and treating the most suitable patients, can benefit more and more patients.
| S-EPMC11313020 | biostudies-literature
Project description:Guided by evolutionarily signaled vulnerabilities in the structure of SARS-CoV-2, we identify epitopes in free monomers of the spike protein that steer the generation of induced or administered antibodies geared at promoting destabilization of the virus quaternary structure, thereby hampering infectivity.
| S-EPMC7552172 | biostudies-literature
Project description:Mycobacterial pathogens adapt to environmental stresses such as nutrient deprivation by entering a non-replicative antibiotic-tolerant state of persistence. Using a biochemically-validated data-driven approach, we identified an adaptive metabolic network underlying the mycobacterial response to starvation in M. tuberculosis, M. bovis BCG and M. smegmatis. All three species show a strong Mg+2-dependence for surviving complete nutrient deprivation, accompanied by a broad phenotypic antibiotic resistance. Multivariate analysis of RNA-seq, metabolic phenotyping and biochemical data revealed substantial metabolic remodelling involving a shift to triacylglycerol utilization with adaptation to the consequent ketoacidosis by upregulation of cytochrome P450s. Paradoxically, the ketosis-driven P450 upregulation generated substantial levels of reactive oxygen species (ROS) yet conferred hypersensitivity to killing by hydrogen peroxide-induced inactivation of the P450s that reduced ROS levels. This emergent property of starvation-induced mycobacterial persistence represents a potentially exploitable vulnerability.
2016-08-25 | GSE66883 | GEO
Project description: Not available
| S-EPMC5368489 | biostudies-literature
Project description:Ovarian cancer is the leading cause of death among gynecological cancers. It exhibits great heterogeneity in tumor biology and treatment response. Germline mutations of DNA repair genes BRCA1/2 are the fundamental defects in hereditary ovarian cancer that expresses a distinct phenotype of high response rates to platinum agents, improved disease-free intervals and survival rates, and high-grade serous histology. The term "BRCAness" describes the phenotypic traits that some sporadic ovarian tumors share with tumors in BRCA1/2 germline mutation carriers and reflects similar causative molecular abnormalities. BRCA pathway studies and molecular profiling reveal BRCA-related defects in almost half of the cases of ovarian cancer. BRCA-like tumors are particularly sensitive to DNA-damaging agents (e.g., platinum agents) because of inadequate BRCA-mediated DNA repair mechanisms, such as nucleotide-excision repair and homologous recombination (HR). Additional inhibition of other DNA repair pathways leads to synthetic lethality in HR-deficient cells; this has been employed in the treatment of BRCA-like ovarian tumors with poly(ADP-ribose) polymerase inhibitors with promising results. This article presents a comprehensive review of the relevant literature on the role of BRCAness in ovarian cancer with respect to BRCA function, methods of BRCA epigenetic defect detection and molecular profiling, and the implications of BRCA dysfunction in the treatment of ovarian cancer.
| S-EPMC3399652 | biostudies-literature
Project description:The massive forests of central Amazonia are often considered relatively resilient against climatic variation, but this view is challenged by the wildfires invoked by recent droughts. The impact of such fires that spread from pervasive sources of ignition may reveal where forests are less likely to persist in a drier future. Here we combine field observations with remotely sensed information for the whole Amazon to show that the annually inundated lowland forests that run through the heart of the system may be trapped relatively easily into a fire-dominated savanna state. This lower forest resilience on floodplains is suggested by patterns of tree cover distribution across the basin, and supported by our field and remote sensing studies showing that floodplain fires have a stronger and longer-lasting impact on forest structure as well as soil fertility. Although floodplains cover only 14% of the Amazon basin, their fires can have substantial cascading effects because forests and peatlands may release large amounts of carbon, and wildfires can spread to adjacent uplands. Floodplains are thus an Achilles' heel of the Amazon system when it comes to the risk of large-scale climate-driven transitions.
| S-EPMC5410816 | biostudies-other
Project description:Myocardial ischaemia/reperfusion injury leading to myocardial infarction is one of the most frequent causes of debilitation and death in man. Considerable research has been undertaken to investigate the possibility of reducing myocardial infarction and increasing cell survival by activating certain endogenous prosurvival signaling pathways. Thus, it has been established that the activation of the PI3K (Phosphoinositide-3 kinase)/Akt (Protein kinase B, PKB) signaling pathway is essential for protection against ischaemia/reperfusion injury. This pathway has been shown to be activated by mechanical procedures (e.g. pre and post conditioning) as well as by a number of pharmacological agents. Although the activation of this prosurvival signaling pathway induces the phosphorylation of a large number of substrates implicated in increased cell survival, when activated over a prolonged period this pathway can have detrimental consequences by facilitating unwanted growth and malignancies. Importantly PTEN (phosphatase and tensin homolog deleted on chromosome ten), is the main phosphatase which negatively regulates the PI3K/Akt pathway. In this review we discuss: a) the significance and the limitations of inhibiting PTEN in myocardial ischaemia/reperfusion injury; b) PTEN and its relationship to ischaemic preconditioning, c) the role of PTEN in the development of tolerance to chronic administration of drugs known to limit infarction by activating PI3K/Akt pathway when given acutely, and d) the possible role of PTEN in the ischaemic/reperfused diabetic heart. The experimental evidence discussed in this review illustrates the importance of PTEN inhibition in the protection of the heart against ischaemia/reperfusion injury.
| S-EPMC2013879 | biostudies-other
Project description:The networks of blood and lymphatic vessels and of the extracellular matrix and their cellular and structural components, that are collectively termed the tumor microenvironment, are frequently co-opted and shaped by cancer cells to survive, invade, and form distant metastasis. With an enviable capacity to adapt to continually changing environments, cancer represents the epitome of functional chaos, a stark contrast to the hierarchical and organized differentiation processes that dictate the development and life of biological organisms. The consequences of changing landscapes such as hypoxia and acidic extracellular pH in and around tumors create a cascade of changes in multiple pathways and networks that become apparent only several years later as recurrence and metastasis. These molecular and phenotypic changes, several of which are mediated by COX-2, approach the complexities of a "Gordian Knot." We review evidence from our studies and from literature suggesting that cyclooxygenase-2 (COX-2) biology presents a nodal point in cancer biology and an "Achilles heel" of COX-2-dependent tumors.
| S-EPMC3619664 | biostudies-literature
Project description:Widespread antimicrobial resistance among bacterial pathogens is a serious threat to public health. Thus, identification of new targets and development of new antibacterial agents are urgently needed. Although cell division is a major driver of bacterial colonization and pathogenesis, its targeting with antibacterial compounds is still in its infancy. FtsZ, a bacterial cytoskeletal homolog of eukaryotic tubulin, plays a highly conserved and foundational role in cell division and has been the primary focus of research on small molecule cell division inhibitors. FtsZ contains two drug-binding pockets: the GTP binding site situated at the interface between polymeric subunits, and the inter-domain cleft (IDC), located between the N-terminal and C-terminal segments of the core globular domain of FtsZ. The majority of anti-FtsZ molecules bind to the IDC. Compounds that bind instead to the GTP binding site are much less useful as potential antimicrobial therapeutics because they are often cytotoxic to mammalian cells, due to the high sequence similarity between the GTP binding sites of FtsZ and tubulin. Fortunately, the IDC has much less sequence and structural similarity with tubulin, making it a better potential target for drugs that are less toxic to humans. Over the last decade, a large number of natural and synthetic IDC inhibitors have been identified. Here we outline the molecular structure of IDC in detail and discuss how it has become a crucial target for broad spectrum and species-specific antibacterial agents. We also outline the drugs that bind to the IDC and their modes of action.
| S-EPMC8456036 | biostudies-literature
Project description:IntroductionThe importance of management to the implementation of integrated care is recognised in evidence and practice. Despite this recognition, there is a lack of clarity about what 'good' management of integrated care looks like, if the competences are different to management for 'traditional' care, and how such competences can be acquired.Theory and methodsThis exploratory study is based on qualitative interviews with participants with extensive experience of implementing integrated care in senior professional, research, administrative and/or policy roles. It conceptualises management as working at 'strategic' and 'operational' levels.ResultsManagement of integrated care was seen to require an ability to create networks across professions and organisations, to be comfortable with distributing responsibilities, and to thoroughly understand the wider system. Competences to support these new ways of working included an understanding of how to implement people-centredness, to have courage to challenge the status quo, and to demonstrate humility to learn from others. Structured development opportunities for managers were lacking, but seen as vital for the sustainability of change.Discussion and conclusionManagement for integrated care remains an underdeveloped concept and practice. A first formulation of the competences necessary was achieved, but more work is urgently required to understand how to better prepare and support managers to achieve necessary changes in practice and culture.
| S-EPMC7047758 | biostudies-literature