Dataset Information

Use of test accuracy study design labels in NICE's diagnostic guidance.

ABSTRACT:

Background

A variety of study designs are available to evaluate the accuracy of tests, but the terms used to describe these designs seem to lack clarity and standardization. We investigated if this was the case in the diagnostic guidance of the National Institute of Care and Health Excellence (NICE), an influential source of advice on the value of tests.

Objectives

To describe the range of study design terms and labels used to distinguish study designs in NICE Diagnostic Guidance and the underlying evidence reports.

Methods

We carefully examined all NICE Diagnostic Guidance that has been developed from inception in 2011 until 2018 and the corresponding diagnostic assessment reports that summarized the evidence, focusing on guidance where tests were considered for diagnosis. We abstracted labels used to describe study designs and investigated what labels were used when studies were weighted differently because of their design (in terms of validity of evidence), in relevant sections. We made a descriptive analysis to assess the range of labels and also categorized labels by design features.

Results

From a total of 36 pieces of guidance, 20 (56%) were eligible and 17 (47%) were included in our analysis. We identified 53 unique design labels, of which 19 (36%) were specific to diagnostic test accuracy designs. These referred to a total of 12 study design features. Labels were used in assigning different weights to studies in seven of the reports (41%) but never in the guidance documents.

Conclusion

Our study confirms a lack of clarity and standardization of test accuracy study design terms. There seems to be scope to reduce and harmonize the number of terms and still capture the design features that were deemed influential by those compiling the evidence reports. This should help decision makers in quickly identifying subgroups of included studies that should be weighted differently because their designs are more susceptible to bias.

SUBMITTER: Olsen M

PROVIDER: S-EPMC6727490 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Use of test accuracy study design labels in NICE's diagnostic guidance.

Olsen M M Zhelev Z Z Hunt H H Peters J L JL Bossuyt P P Hyde C C

Diagnostic and prognostic research 20190905

<h4>Background</h4>A variety of study designs are available to evaluate the accuracy of tests, but the terms used to describe these designs seem to lack clarity and standardization. We investigated if this was the case in the diagnostic guidance of the National Institute of Care and Health Excellence (NICE), an influential source of advice on the value of tests.<h4>Objectives</h4>To describe the range of study design terms and labels used to distinguish study designs in NICE Diagnostic Guidance ...[more]

PMID: 31517065

Similar Datasets

Project description:BACKGROUND:Diabetic retinopathy (DR), a common complication of diabetes mellitus, is the leading cause of impaired vision in adults worldwide. Smartphone ophthalmoscopy involves using a smartphone camera for digital retinal imaging. Utilizing smartphones to detect DR is potentially more affordable, accessible, and easier to use than conventional methods. OBJECTIVE:This study aimed to determine the diagnostic accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients. METHODS:We performed an electronic search on the Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, and Cochrane Library for literature published from January 2000 to November 2018. We included studies involving diabetic patients, which compared the diagnostic accuracy of smartphone ophthalmoscopy for detecting DR to an accurate or commonly employed reference standard, such as indirect ophthalmoscopy, slit-lamp biomicroscopy, and tabletop fundus photography. Two reviewers independently screened studies against the inclusion criteria, extracted data, and assessed the quality of included studies using the Quality Assessment of Diagnostic Accuracy Studies-2 tool, with disagreements resolved via consensus. Sensitivity and specificity were pooled using the random effects model. A summary receiver operating characteristic (SROC) curve was constructed. This review is reported in line with the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies guidelines. RESULTS:In all, nine studies involving 1430 participants were included. Most studies were of high quality, except one study with limited applicability because of its reference standard. The pooled sensitivity and specificity for detecting any DR was 87% (95% CI 74%-94%) and 94% (95% CI 81%-98%); mild nonproliferative DR (NPDR) was 39% (95% CI 10%-79%) and 95% (95% CI 91%-98%); moderate NPDR was 71% (95% CI 57%-81%) and 95% (95% CI 88%-98%); severe NPDR was 80% (95% CI 49%-94%) and 97% (95% CI 88%-99%); proliferative DR (PDR) was 92% (95% CI 79%-97%) and 99% (95% CI 96%-99%); diabetic macular edema was 79% (95% CI 63%-89%) and 93% (95% CI 82%-97%); and referral-warranted DR was 91% (95% CI 86%-94%) and 89% (95% CI 56%-98%). The area under SROC curve ranged from 0.879 to 0.979. The diagnostic odds ratio ranged from 11.3 to 1225. CONCLUSIONS:We found heterogeneous evidence showing that smartphone ophthalmoscopy performs well in detecting DR. The diagnostic accuracy for PDR was highest. Future studies should standardize reference criteria and classification criteria and evaluate other available forms of smartphone ophthalmoscopy in primary care settings.

Project description:BackgroundMost tuberculosis-related deaths in people with HIV could be prevented with earlier diagnosis and treatment. The only commercially available tuberculosis point-of-care test (Alere Determine TB LAM Ag [AlereLAM]) has suboptimal sensitivity, which restricts its use in clinical practice. The novel Fujifilm SILVAMP TB LAM (FujiLAM) assay has been developed to improve the sensitivity of AlereLAM. We assessed the diagnostic accuracy of the FujiLAM assay for the detection of tuberculosis in hospital inpatients with HIV compared with the AlereLAM assay.MethodsFor this diagnostic accuracy study, we assessed biobanked urine samples obtained from the FIND Specimen Bank and the University of Cape Town Biobank, which had been collected from hospital inpatients (aged ?18 years) with HIV during three independent prospective cohort studies done at two South African hospitals. Urine samples were tested using FujiLAM and AlereLAM assays. The conduct and reporting of each test was done blind to other test results. The primary objective was to assess the diagnostic accuracy of FujiLAM compared with AlereLAM, against microbiological and composite reference standards (including clinical diagnoses).FindingsBetween April 18, 2018, and May 3, 2018, urine samples from 968 hospital inpatients with HIV were evaluated. The prevalence of microbiologically-confirmed tuberculosis was 62% and the median CD4 count was 86 cells per ?L. Using the microbiological reference standard, the estimated sensitivity of FujiLAM was 70·4% (95% CI 53·0 to 83·1) compared with 42·3% (31·7 to 51·8) for AlereLAM (difference 28·1%) and the estimated specificity of FujiLAM was 90·8% (86·0 to 94·4) and 95·0% (87·7-98·8) for AlereLAM (difference -4·2%). Against the composite reference standard, the specificity of both assays was higher (95·7% [92·0 to 98·0] for FujiLAM vs 98·2% [95·7 to 99·6] for AlereLAM; difference -2·5%), but the sensitivity of both assays was lower (64·9% [50·1 to 76·7] for FujiLAM vs 38·2% [28·1 to 47·3] for AlereLAM; difference 26·7%).InterpretationIn comparison to AlereLAM, FujiLAM offers superior diagnostic sensitivity, while maintaining specificity, and could transform rapid point-of-care tuberculosis diagnosis for hospital inpatients with HIV. The applicability of FujiLAM for settings of intended use requires prospective assessment.FundingGlobal Health Innovative Technology Fund, UK Department for International Development, Dutch Ministry of Foreign Affairs, Bill & Melinda Gates Foundation, German Federal Ministry of Education and Research, Australian Department of Foreign Affairs and Trade, Wellcome Trust, Department of Science and Technology and National Research Foundation of South Africa, and South African Medical Research Council.

Dataset Information

Use of test accuracy study design labels in NICE's diagnostic guidance.

Background

Objectives

Methods

Results

Conclusion

Publications

Use of test accuracy study design labels in NICE's diagnostic guidance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets