Dataset Information

Use of test accuracy study design labels in NICE's diagnostic guidance.

ABSTRACT:

Background

A variety of study designs are available to evaluate the accuracy of tests, but the terms used to describe these designs seem to lack clarity and standardization. We investigated if this was the case in the diagnostic guidance of the National Institute of Care and Health Excellence (NICE), an influential source of advice on the value of tests.

Objectives

To describe the range of study design terms and labels used to distinguish study designs in NICE Diagnostic Guidance and the underlying evidence reports.

Methods

We carefully examined all NICE Diagnostic Guidance that has been developed from inception in 2011 until 2018 and the corresponding diagnostic assessment reports that summarized the evidence, focusing on guidance where tests were considered for diagnosis. We abstracted labels used to describe study designs and investigated what labels were used when studies were weighted differently because of their design (in terms of validity of evidence), in relevant sections. We made a descriptive analysis to assess the range of labels and also categorized labels by design features.

Results

From a total of 36 pieces of guidance, 20 (56%) were eligible and 17 (47%) were included in our analysis. We identified 53 unique design labels, of which 19 (36%) were specific to diagnostic test accuracy designs. These referred to a total of 12 study design features. Labels were used in assigning different weights to studies in seven of the reports (41%) but never in the guidance documents.

Conclusion

Our study confirms a lack of clarity and standardization of test accuracy study design terms. There seems to be scope to reduce and harmonize the number of terms and still capture the design features that were deemed influential by those compiling the evidence reports. This should help decision makers in quickly identifying subgroups of included studies that should be weighted differently because their designs are more susceptible to bias.

SUBMITTER: Olsen M

PROVIDER: S-EPMC6727490 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Use of test accuracy study design labels in NICE's diagnostic guidance.

Olsen M M Zhelev Z Z Hunt H H Peters J L JL Bossuyt P P Hyde C C

Diagnostic and prognostic research 20190905

<h4>Background</h4>A variety of study designs are available to evaluate the accuracy of tests, but the terms used to describe these designs seem to lack clarity and standardization. We investigated if this was the case in the diagnostic guidance of the National Institute of Care and Health Excellence (NICE), an influential source of advice on the value of tests.<h4>Objectives</h4>To describe the range of study design terms and labels used to distinguish study designs in NICE Diagnostic Guidance ...[more]

PMID: 31517065

Similar Datasets

Project description:BackgroundDiabetic retinopathy (DR), a common complication of diabetes mellitus, is the leading cause of impaired vision in adults worldwide. Smartphone ophthalmoscopy involves using a smartphone camera for digital retinal imaging. Utilizing smartphones to detect DR is potentially more affordable, accessible, and easier to use than conventional methods.ObjectiveThis study aimed to determine the diagnostic accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients.MethodsWe performed an electronic search on the Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, and Cochrane Library for literature published from January 2000 to November 2018. We included studies involving diabetic patients, which compared the diagnostic accuracy of smartphone ophthalmoscopy for detecting DR to an accurate or commonly employed reference standard, such as indirect ophthalmoscopy, slit-lamp biomicroscopy, and tabletop fundus photography. Two reviewers independently screened studies against the inclusion criteria, extracted data, and assessed the quality of included studies using the Quality Assessment of Diagnostic Accuracy Studies-2 tool, with disagreements resolved via consensus. Sensitivity and specificity were pooled using the random effects model. A summary receiver operating characteristic (SROC) curve was constructed. This review is reported in line with the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies guidelines.ResultsIn all, nine studies involving 1430 participants were included. Most studies were of high quality, except one study with limited applicability because of its reference standard. The pooled sensitivity and specificity for detecting any DR was 87% (95% CI 74%-94%) and 94% (95% CI 81%-98%); mild nonproliferative DR (NPDR) was 39% (95% CI 10%-79%) and 95% (95% CI 91%-98%); moderate NPDR was 71% (95% CI 57%-81%) and 95% (95% CI 88%-98%); severe NPDR was 80% (95% CI 49%-94%) and 97% (95% CI 88%-99%); proliferative DR (PDR) was 92% (95% CI 79%-97%) and 99% (95% CI 96%-99%); diabetic macular edema was 79% (95% CI 63%-89%) and 93% (95% CI 82%-97%); and referral-warranted DR was 91% (95% CI 86%-94%) and 89% (95% CI 56%-98%). The area under SROC curve ranged from 0.879 to 0.979. The diagnostic odds ratio ranged from 11.3 to 1225.ConclusionsWe found heterogeneous evidence showing that smartphone ophthalmoscopy performs well in detecting DR. The diagnostic accuracy for PDR was highest. Future studies should standardize reference criteria and classification criteria and evaluate other available forms of smartphone ophthalmoscopy in primary care settings.

Project description:INTRODUCTION:Diabetic retinopathy (DR) is a common microvascular complication of diabetes mellitus and the leading cause of impaired vision in adults worldwide. Early detection and treatment for DR could improve patient outcomes. Traditional methods of detecting DR include the gold standard Early Treatment Diabetic Retinopathy Study seven standard fields fundus photography, ophthalmoscopy and slit-lamp biomicroscopy. These modalities can be expensive, difficult to access and require involvement of specialised healthcare professionals. With the development of mobile phone technology, there is a growing interest in their use for DR identification as this approach is potentially more affordable, accessible and easier to use. Smartphones can be employed in a variety of ways for ophthalmoscopy including the use of smartphone camera, various attachments and artificial intelligence for obtaining and grading of retinal images. The aim of this scoping review is to determine the diagnostic test accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients. METHODS AND ANALYSIS:We will perform an electronic search of MEDLINE, Embase and Cochrane Library for literature published from 2000 onwards. Two reviewers will independently analyse studies for eligibility and assess study quality using the QUADAS-2 tool. Data for a 2?2 contingency table will be extracted. If possible, we will pool sensitivity and specificity data using the random-effects model and construct a summary receiver operating characteristic curve. In case of high heterogeneity, we will present the findings narratively. Subgroup analysis and sensitivity analysis will be performed where appropriate. ETHICS AND DISSEMINATION:This scoping review aims to provide an overview of smartphone ophthalmoscopy in DR identification. It will present findings on the accuracy of smartphone ophthalmoscopy in detecting DR, identify gaps in the literature and provide recommendations for future research. This review does not require ethical approval as we will not collect primary data.

Project description:BackgroundMost tuberculosis-related deaths in people with HIV could be prevented with earlier diagnosis and treatment. The only commercially available tuberculosis point-of-care test (Alere Determine TB LAM Ag [AlereLAM]) has suboptimal sensitivity, which restricts its use in clinical practice. The novel Fujifilm SILVAMP TB LAM (FujiLAM) assay has been developed to improve the sensitivity of AlereLAM. We assessed the diagnostic accuracy of the FujiLAM assay for the detection of tuberculosis in hospital inpatients with HIV compared with the AlereLAM assay.MethodsFor this diagnostic accuracy study, we assessed biobanked urine samples obtained from the FIND Specimen Bank and the University of Cape Town Biobank, which had been collected from hospital inpatients (aged ≥18 years) with HIV during three independent prospective cohort studies done at two South African hospitals. Urine samples were tested using FujiLAM and AlereLAM assays. The conduct and reporting of each test was done blind to other test results. The primary objective was to assess the diagnostic accuracy of FujiLAM compared with AlereLAM, against microbiological and composite reference standards (including clinical diagnoses).FindingsBetween April 18, 2018, and May 3, 2018, urine samples from 968 hospital inpatients with HIV were evaluated. The prevalence of microbiologically-confirmed tuberculosis was 62% and the median CD4 count was 86 cells per μL. Using the microbiological reference standard, the estimated sensitivity of FujiLAM was 70·4% (95% CI 53·0 to 83·1) compared with 42·3% (31·7 to 51·8) for AlereLAM (difference 28·1%) and the estimated specificity of FujiLAM was 90·8% (86·0 to 94·4) and 95·0% (87·7-98·8) for AlereLAM (difference -4·2%). Against the composite reference standard, the specificity of both assays was higher (95·7% [92·0 to 98·0] for FujiLAM vs 98·2% [95·7 to 99·6] for AlereLAM; difference -2·5%), but the sensitivity of both assays was lower (64·9% [50·1 to 76·7] for FujiLAM vs 38·2% [28·1 to 47·3] for AlereLAM; difference 26·7%).InterpretationIn comparison to AlereLAM, FujiLAM offers superior diagnostic sensitivity, while maintaining specificity, and could transform rapid point-of-care tuberculosis diagnosis for hospital inpatients with HIV. The applicability of FujiLAM for settings of intended use requires prospective assessment.FundingGlobal Health Innovative Technology Fund, UK Department for International Development, Dutch Ministry of Foreign Affairs, Bill & Melinda Gates Foundation, German Federal Ministry of Education and Research, Australian Department of Foreign Affairs and Trade, Wellcome Trust, Department of Science and Technology and National Research Foundation of South Africa, and South African Medical Research Council.

Dataset Information

Use of test accuracy study design labels in NICE's diagnostic guidance.

Background

Objectives

Methods

Results

Conclusion

Publications

Use of test accuracy study design labels in NICE's diagnostic guidance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets