Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part I. General Guidance and Tips.
Ontology highlight
ABSTRACT:
SUBMITTER: Kim KW
PROVIDER: S-EPMC4644738 | biostudies-literature | 2015 Nov-Dec
REPOSITORIES: biostudies-literature
Publications
Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part I. General Guidance and Tips.
Kim Kyung Won KW Lee Juneyoung J Choi Sang Hyun SH Huh Jimi J Park Seong Ho SH
Korean journal of radiology 20151026 6
In the field of diagnostic test accuracy (DTA), the use of systematic review and meta-analyses is steadily increasing. By means of objective evaluation of all available primary studies, these two processes generate an evidence-based systematic summary regarding a specific research topic. The methodology for systematic review and meta-analysis in DTA studies differs from that in therapeutic/interventional studies, and its content is still evolving. Here we review the overall process from a practi ...[more]
Similar Datasets
Project description:In the last decades, statistical methodology has developed rapidly, in particular in the field of regression modeling. Multivariable regression models are applied in almost all medical research projects. Therefore, the potential impact of statistical misconceptions within this field can be enormous Indeed, the current theoretical statistical knowledge is not always adequately transferred to the current practice in medical statistics. Some medical journals have identified this problem and published isolated statistical articles and even whole series thereof. In this systematic review, we aim to assess the current level of education on regression modeling that is provided to medical researchers via series of statistical articles published in medical journals. The present manuscript is a protocol for a systematic review that aims to assess which aspects of regression modeling are covered by statistical series published in medical journals that intend to train and guide applied medical researchers with limited statistical knowledge. Statistical paper series cannot easily be summarized and identified by common keywords in an electronic search engine like Scopus. We therefore identified series by a systematic request to statistical experts who are part or related to the STRATOS Initiative (STRengthening Analytical Thinking for Observational Studies). Within each identified article, two raters will independently check the content of the articles with respect to a predefined list of key aspects related to regression modeling. The content analysis of the topic-relevant articles will be performed using a predefined report form to assess the content as objectively as possible. Any disputes will be resolved by a third reviewer. Summary analyses will identify potential methodological gaps and misconceptions that may have an important impact on the quality of analyses in medical research. This review will thus provide a basis for future guidance papers and tutorials in the field of regression modeling which will enable medical researchers 1) to interpret publications in a correct way, 2) to perform basic statistical analyses in a correct way and 3) to identify situations when the help of a statistical expert is required.
| S-EPMC7751867 | biostudies-literature
Project description:Multiple comparisons tests (MCTs) include the statistical tests used to compare groups (treatments) often following a significant effect reported in one of many types of linear models. Due to a variety of data and statistical considerations, several dozen MCTs have been developed over the decades, with tests ranging from very similar to each other to very different from each other. Many scientific disciplines use MCTs, including >40,000 reports of their use in ecological journals in the last 60 years. Despite the ubiquity and utility of MCTs, several issues remain in terms of their correct use and reporting. In this study, we evaluated 17 different MCTs. We first reviewed the published literature for recommendations on their correct use. Second, we created a simulation that evaluated the performance of nine common MCTs. The tests examined in the simulation were those that often overlapped in usage, meaning the selection of the test based on fit to the data is not unique and that the simulations could inform the selection of one or more tests when a researcher has choices. Based on the literature review and recommendations: planned comparisons are overwhelmingly recommended over unplanned comparisons, for planned non-parametric comparisons the Mann-Whitney-Wilcoxon U test is recommended, Scheffé's S test is recommended for any linear combination of (unplanned) means, Tukey's HSD and the Bonferroni or the Dunn-Sidak tests are recommended for pairwise comparisons of groups, and that many other tests exist for particular types of data. All code and data used to generate this paper are available at: https://github.com/stevemidway/MultipleComparisons.
| S-EPMC7720730 | biostudies-literature
Project description:BackgroundA variety of study designs are available to evaluate the accuracy of tests, but the terms used to describe these designs seem to lack clarity and standardization. We investigated if this was the case in the diagnostic guidance of the National Institute of Care and Health Excellence (NICE), an influential source of advice on the value of tests.ObjectivesTo describe the range of study design terms and labels used to distinguish study designs in NICE Diagnostic Guidance and the underlying evidence reports.MethodsWe carefully examined all NICE Diagnostic Guidance that has been developed from inception in 2011 until 2018 and the corresponding diagnostic assessment reports that summarized the evidence, focusing on guidance where tests were considered for diagnosis. We abstracted labels used to describe study designs and investigated what labels were used when studies were weighted differently because of their design (in terms of validity of evidence), in relevant sections. We made a descriptive analysis to assess the range of labels and also categorized labels by design features.ResultsFrom a total of 36 pieces of guidance, 20 (56%) were eligible and 17 (47%) were included in our analysis. We identified 53 unique design labels, of which 19 (36%) were specific to diagnostic test accuracy designs. These referred to a total of 12 study design features. Labels were used in assigning different weights to studies in seven of the reports (41%) but never in the guidance documents.ConclusionOur study confirms a lack of clarity and standardization of test accuracy study design terms. There seems to be scope to reduce and harmonize the number of terms and still capture the design features that were deemed influential by those compiling the evidence reports. This should help decision makers in quickly identifying subgroups of included studies that should be weighted differently because their designs are more susceptible to bias.
| S-EPMC6727490 | biostudies-literature
Project description:Tests that can replace sputum smear microscopy have been identified as a top priority diagnostic need for tuberculosis by the World Health Organization. High-quality evidence on diagnostic accuracy for tests that may meet this need is an essential requirement to inform decisions about policy and scale-up. However, test accuracy studies are often of low and inconsistent quality and poorly reported, leading to uncertainty about true test performance. Here we provide guidance for the design of diagnostic test accuracy studies of sputum smear-replacement tests. Such studies should have a cross-sectional or cohort design, enrolling either a consecutive series or a random sample of patients who require evaluation for tuberculosis. Adults with respiratory symptoms are the target population. The reference standard should at a minimum be a single, automated, liquid culture, but additional cultures, follow-up, clinical case definition, and specific measures to understand discordant results should also be included. Inclusion of smear microscopy and Xpert MTB/RIF (or MTB/RIF Ultra) as comparators is critical to allow broader comparability and generalizability of results, because disease spectrum can vary between studies and affects relative test performance. Given the complex nature of sputum (the primary specimen type used for pulmonary TB), careful design and reporting of the specimen flow is essential. Test characteristics other than accuracy (such as feasibility, implementation considerations, and data on impact on patient, population and health systems outcomes) are also important aspects.
| S-EPMC6782025 | biostudies-literature
Project description:It is acknowledged that the COVID-19 pandemic has caused profound disruption to the delivery of healthcare services globally. This has affected the management of many long-term conditions including osteoporosis as resources are diverted to cover urgent care. Osteoporosis is a public health concern worldwide and treatment is required for the prevention of further bone loss, deterioration of skeletal micro-architecture, and fragility fractures. This review provides information on how the COVID-19 pandemic has impacted the diagnosis and management of osteoporosis. We also provide clinical recommendations on the adaptation of care pathways based on experience from five referral centres to ensure that patients with osteoporosis are still treated and to reduce the risk of fractures both for the individual patient and on a societal basis. We address the use of the FRAX tool for risk stratification and initiation of osteoporosis treatment and discuss the potential adaptations to treatment pathways in view of limitations on the availability of DXA. We focus on the issues surrounding initiation and maintenance of treatment for patients on parenteral therapies such as zoledronate, denosumab, teriparatide, and romosozumab during the pandemic. The design of these innovative care pathways for the management of patients with osteoporosis may also provide a platform for future improvement to osteoporosis services when routine clinical care resumes.
| S-EPMC8129963 | biostudies-literature
Project description:A systematic review was conducted to assess the diagnostic test accuracy of polymerase chain reaction (PCR)-based microsatellite instability (MSI) testing for identifying Lynch syndrome in patients with colorectal cancer (CRC). Unlike previous reviews, this was based on assessing MSI testing against best practice for the reference standard, and included CRC populations that were unselected, age-limited or high-risk for Lynch syndrome.Single- and two-gate diagnostic test accuracy studies, or similar, were identified, assessed for inclusion, data extracted and quality appraised by two reviewers according to a pre-specified protocol. Sensitivity of MSI testing was estimated for all included studies. Specificity, likelihood ratios and predictive values were estimated for studies that were not based on high-risk samples. Narrative synthesis was conducted.Nine study samples were included. When MSI-Low results were considered to be negative, sensitivity estimates ranged from 67% (95% CI 47, 83) to 100% (95% CI 94, 100). Three studies contributed to estimates of both sensitivity and specificity, with specificity ranging from 61% (95% CI 57, 65), to 93% (95% CI 89, 95). Good sensitivity was achieved at the expense of specificity. When MSI-L was considered to be positive (effectively lowering the threshold for a positive index test result) sensitivity increased and specificity decreased. Between-study heterogeneity in both the MSI and reference standard testing, combined with the low number of studies contributing to both sensitivity and specificity estimates, precluded pooling by meta-analysis.MSI testing is an effective screening test for Lynch syndrome. However, there is significant uncertainty surrounding what balance of sensitivity and specificity will be achieved in clinical practice and how this relates to specific characteristics of the test (such as the panel of markers used or the thresholds used to denote a positive test).
| S-EPMC5723028 | biostudies-literature
Project description:Brentuximab vedotin (BV), a potent antibody-drug conjugate, targets the CD30 antigen. Owing to the remarkable efficacy shown in CD30-positive lymphomas, such as Hodgkin's lymphoma and systemic anaplastic large-cell lymphoma, BV was granted accelerated approval in 2011 by the US Food and Drug Administration. Thereafter, many large-scale trials in various situations have been performed, which led to extensions of the original indication. The aim of this review was to describe the latest updates on clinical trials of BV and the in-practice guidance for the use of BV.
| S-EPMC5762734 | biostudies-literature
Project description:Rickets is a disease of the growing child arising from alterations in calcium and phosphate homeostasis resulting in impaired apoptosis of hypertrophic chondrocytes in the growth plate. Its symptoms depend on the patients' age, duration of disease, and underlying disorder. Common features include thickened wrists and ankles due to widened metaphyses, growth failure, bone pain, muscle weakness, waddling gait, and leg bowing. Affected infants often show delayed closure of the fontanelles, frontal bossing, and craniotabes. The diagnosis of rickets is based on the presence of these typical clinical symptoms and radiological findings on X-rays of the wrist or knee, showing metaphyseal fraying and widening of growth plates, in conjunction with elevated serum levels of alkaline phosphatase. Nutritional rickets due to vitamin D deficiency and/or dietary calcium deficiency is the most common cause of rickets. Currently, more than 20 acquired or hereditary causes of rickets are known. The latter are due to mutations in genes involved in vitamin D metabolism or action, renal phosphate reabsorption, or synthesis, or degradation of the phosphaturic hormone fibroblast growth factor 23 (FGF23). There is a substantial overlap in the clinical features between the various entities, requiring a thorough workup using biochemical analyses and, if necessary, genetic tests. Part I of this review focuses on the etiology, pathophysiology and clinical findings of rickets followed by the presentation of a diagnostic approach for correct diagnosis. Part II focuses on the management of rickets, including new therapeutic approaches based on recent clinical practice guidelines.
| S-EPMC9307538 | biostudies-literature
Project description:BackgroundImage guidance has been clinically available for over a period of 20 years. Although research increasingly has a translational emphasis, overall the clinical uptake of image guidance systems in surgery remains low. The objective of this review was to establish the metrics used to report on the impact of surgical image guidance systems used in a clinical setting.MethodsA systematic review of the literature was carried out on all relevant publications between January 2000 and April 2016. Ovid MEDLINE and Embase databases were searched using a title strategy. Reported outcome metrics were grouped into clinically relevant domains and subsequent sub-categories for analysis.ResultsIn total, 232 publications were eligible for inclusion. Analysis showed that clinical outcomes and system interaction were consistently reported. However, metrics focusing on surgeon, patient and economic impact were reported less often. No increase in the quality of reporting was observed during the study time period, associated with study design, or when the clinical setting involved a surgical specialty that had been using image guidance for longer.ConclusionsPublications reporting on the clinical use of image guidance systems are evaluating traditional surgical outcomes and neglecting important human and economic factors, which are pertinent to the uptake, diffusion and sustainability of image-guided surgery. A framework is proposed to assist researchers in providing comprehensive evaluation metrics, which should also be considered in the design phase. Use of these would help demonstrate the impact in the clinical setting leading to increased clinical integration of image guidance systems.
| S-EPMC6684543 | biostudies-literature
Project description:Stakeholder engagement is increasingly common in health research, with protocols for engaging multiple stakeholder groups becoming normative in patient-centered outcomes research. Previous work has focused on identifying relevant stakeholder groups with whom to work and on working with stakeholders in evidence implementation. This paper draws on the expertise of a team from four countries-Canada, Australia, the UK, and the USA-to provide researchers with practical guidance for carrying out multi-stakeholder-engaged projects: we present a list of questions to assist in selecting appropriate roles and modes of engagement; we introduce a matrix to help summarize engagement activities; and we provide a list of online resources. This guidance, matrix, and list of resources can assist researchers to consider more systematically which stakeholder groups to involve, in what study roles, and by what modes of engagement. By documenting how stakeholders are paired up with specific roles, the matrix also provides a potential structure for evaluating the impact of stakeholder engagement.
| S-EPMC6420667 | biostudies-literature