Dataset Information

Summarising and validating test accuracy results across multiple studies for use in clinical practice.

ABSTRACT: Following a meta-analysis of test accuracy studies, the translation of summary results into clinical practice is potentially problematic. The sensitivity, specificity and positive (PPV) and negative (NPV) predictive values of a test may differ substantially from the average meta-analysis findings, because of heterogeneity. Clinicians thus need more guidance: given the meta-analysis, is a test likely to be useful in new populations, and if so, how should test results inform the probability of existing disease (for a diagnostic test) or future adverse outcome (for a prognostic test)? We propose ways to address this. Firstly, following a meta-analysis, we suggest deriving prediction intervals and probability statements about the potential accuracy of a test in a new population. Secondly, we suggest strategies on how clinicians should derive post-test probabilities (PPV and NPV) in a new population based on existing meta-analysis results and propose a cross-validation approach for examining and comparing their calibration performance. Application is made to two clinical examples. In the first example, the joint probability that both sensitivity and specificity will be >80% in a new population is just 0.19, because of a low sensitivity. However, the summary PPV of 0.97 is high and calibrates well in new populations, with a probability of 0.78 that the true PPV will be at least 0.95. In the second example, post-test probabilities calibrate better when tailored to the prevalence in the new population, with cross-validation revealing a probability of 0.97 that the observed NPV will be within 10% of the predicted NPV.

SUBMITTER: Riley RD

PROVIDER: S-EPMC4973708 | biostudies-literature | 2015 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Summarising and validating test accuracy results across multiple studies for use in clinical practice.

Riley Richard D RD Ahmed Ikhlaaq I Debray Thomas P A TP Willis Brian H BH Noordzij J Pieter JP Higgins Julian P T JP Deeks Jonathan J JJ

Statistics in medicine 20150320 13

Following a meta-analysis of test accuracy studies, the translation of summary results into clinical practice is potentially problematic. The sensitivity, specificity and positive (PPV) and negative (NPV) predictive values of a test may differ substantially from the average meta-analysis findings, because of heterogeneity. Clinicians thus need more guidance: given the meta-analysis, is a test likely to be useful in new populations, and if so, how should test results inform the probability of exi ...[more]

PMID: 25800943

Similar Datasets

Project description:Alemtuzumab (Lemtrada™) is a humanized monoclonal antibody approved in more than 50 countries. Within the European Union, alemtuzumab is indicated for the treatment of adult patients with relapsing-remitting multiple sclerosis (RRMS) with active disease defined by clinical or imaging features; in the USA, the indication states that alemtuzumab should generally be reserved for the treatment of patients with relapsing forms of multiple sclerosis who have had an inadequate response to two or more disease-modifying therapies (DMTs). In clinical trials, alemtuzumab demonstrated efficacy in treatment-naïve patients with active RRMS and those relapsing on prior DMTs, with a consistent and manageable safety and tolerability profile. The European Union indication provides physicians with significant flexibility regarding treatment decisions, affording the opportunity for individualized treatment. Thus, alemtuzumab may be an appropriate treatment choice across a broad range of patients with RRMS, including, for example, treatment-naïve patients with active disease, patients with highly active disease, or for patients relapsing on prior DMTs. There are several practicalities to consider when using alemtuzumab, including the unique dosing regimen, administered via intravenous infusion on 5 consecutive days at baseline and on 3 consecutive days 12 months later, and as-needed retreatment (3 consecutive days at least 12 months after the last course) in cases of disease recurrence. Additionally, routine monthly monitoring is required for up to 48 months after the last infusion to promptly identify potentially serious autoimmune adverse events. Given these considerations, it is beneficial to gain insight into how alemtuzumab is being used in the real-world clinical setting. Here, we report recommendations from European multiple sclerosis experts regarding best practices for alemtuzumab treatment, including management of adverse events and compliance with ongoing safety monitoring requirements.

Project description:BACKGROUND:Diabetic retinopathy (DR), a common complication of diabetes mellitus, is the leading cause of impaired vision in adults worldwide. Smartphone ophthalmoscopy involves using a smartphone camera for digital retinal imaging. Utilizing smartphones to detect DR is potentially more affordable, accessible, and easier to use than conventional methods. OBJECTIVE:This study aimed to determine the diagnostic accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients. METHODS:We performed an electronic search on the Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, and Cochrane Library for literature published from January 2000 to November 2018. We included studies involving diabetic patients, which compared the diagnostic accuracy of smartphone ophthalmoscopy for detecting DR to an accurate or commonly employed reference standard, such as indirect ophthalmoscopy, slit-lamp biomicroscopy, and tabletop fundus photography. Two reviewers independently screened studies against the inclusion criteria, extracted data, and assessed the quality of included studies using the Quality Assessment of Diagnostic Accuracy Studies-2 tool, with disagreements resolved via consensus. Sensitivity and specificity were pooled using the random effects model. A summary receiver operating characteristic (SROC) curve was constructed. This review is reported in line with the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies guidelines. RESULTS:In all, nine studies involving 1430 participants were included. Most studies were of high quality, except one study with limited applicability because of its reference standard. The pooled sensitivity and specificity for detecting any DR was 87% (95% CI 74%-94%) and 94% (95% CI 81%-98%); mild nonproliferative DR (NPDR) was 39% (95% CI 10%-79%) and 95% (95% CI 91%-98%); moderate NPDR was 71% (95% CI 57%-81%) and 95% (95% CI 88%-98%); severe NPDR was 80% (95% CI 49%-94%) and 97% (95% CI 88%-99%); proliferative DR (PDR) was 92% (95% CI 79%-97%) and 99% (95% CI 96%-99%); diabetic macular edema was 79% (95% CI 63%-89%) and 93% (95% CI 82%-97%); and referral-warranted DR was 91% (95% CI 86%-94%) and 89% (95% CI 56%-98%). The area under SROC curve ranged from 0.879 to 0.979. The diagnostic odds ratio ranged from 11.3 to 1225. CONCLUSIONS:We found heterogeneous evidence showing that smartphone ophthalmoscopy performs well in detecting DR. The diagnostic accuracy for PDR was highest. Future studies should standardize reference criteria and classification criteria and evaluate other available forms of smartphone ophthalmoscopy in primary care settings.

Project description:INTRODUCTION:Diabetic retinopathy (DR) is a common microvascular complication of diabetes mellitus and the leading cause of impaired vision in adults worldwide. Early detection and treatment for DR could improve patient outcomes. Traditional methods of detecting DR include the gold standard Early Treatment Diabetic Retinopathy Study seven standard fields fundus photography, ophthalmoscopy and slit-lamp biomicroscopy. These modalities can be expensive, difficult to access and require involvement of specialised healthcare professionals. With the development of mobile phone technology, there is a growing interest in their use for DR identification as this approach is potentially more affordable, accessible and easier to use. Smartphones can be employed in a variety of ways for ophthalmoscopy including the use of smartphone camera, various attachments and artificial intelligence for obtaining and grading of retinal images. The aim of this scoping review is to determine the diagnostic test accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients. METHODS AND ANALYSIS:We will perform an electronic search of MEDLINE, Embase and Cochrane Library for literature published from 2000 onwards. Two reviewers will independently analyse studies for eligibility and assess study quality using the QUADAS-2 tool. Data for a 2?2 contingency table will be extracted. If possible, we will pool sensitivity and specificity data using the random-effects model and construct a summary receiver operating characteristic curve. In case of high heterogeneity, we will present the findings narratively. Subgroup analysis and sensitivity analysis will be performed where appropriate. ETHICS AND DISSEMINATION:This scoping review aims to provide an overview of smartphone ophthalmoscopy in DR identification. It will present findings on the accuracy of smartphone ophthalmoscopy in detecting DR, identify gaps in the literature and provide recommendations for future research. This review does not require ethical approval as we will not collect primary data.

Project description:Antibodies against biopharmaceuticals (anti-drug antibodies, ADA) have been a well-integrated part of the clinical care of multiple sclerosis (MS) in several European countries. ADA data generated in Europe during the more than 10 years of ADA monitoring in MS patients treated with interferon beta (IFN?) and natalizumab have been pooled and characterized through collaboration within a European consortium. The aim of this study was to report on the clinical practice of ADA testing in Europe, considering the number of ADA tests performed and type of ADA assays used, and to determine the frequency of ADA testing against the different drug preparations in different countries. A common database platform (tranSMART) for querying, analyzing and storing retrospective data of MS cohorts was set up to harmonize the data and compare results of ADA tests between different countries. Retrospective data from six countries (Sweden, Austria, Spain, Switzerland, Germany and Denmark) on 20,695 patients and on 42,555 samples were loaded into tranSMART including data points of age, gender, treatment, samples, and ADA results. The previously observed immunogenic difference among the four IFN? preparations was confirmed in this large dataset. Decreased usage of the more immunogenic preparations IFN?-1a subcutaneous (s.c.) and IFN?-1b s.c. in favor of the least immunogenic preparation IFN?-1a intramuscular (i.m.) was observed. The median time from treatment start to first ADA test correlated with time to first positive test. Shorter times were observed for IFN?-1b-Extavia s.c. (0.99 and 0.94 years) and natalizumab (0.25 and 0.23 years), which were introduced on the market when ADA testing was already available, as compared to IFN?-1a i.m. (1.41 and 2.27 years), IFN?-1b-Betaferon s.c. (2.51 and 1.96 years) and IFN?-1a s.c. (2.11 and 2.09 years) which were available years before routine testing began. A higher rate of anti-IFN? ADA was observed in test samples taken from older patients. Testing for ADA varies between different European countries and is highly dependent on the policy within each country. For drugs where routine monitoring of ADA is not in place, there is a risk that some patients remain on treatment for several years despite ADA positivity. For drugs where a strategy of ADA testing is introduced with the release of the drug, there is a reduced risk of having ADA positive patients and thus of less efficient treatment. This indicates that potential savings in health cost might be achieved by routine analysis of ADA.

Dataset Information

Summarising and validating test accuracy results across multiple studies for use in clinical practice.

Publications

Summarising and validating test accuracy results across multiple studies for use in clinical practice.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure