Dataset Information

A simple and robust method for multivariate meta-analysis of diagnostic test accuracy.

ABSTRACT: Meta-analysis of diagnostic test accuracy often involves mixture of case-control and cohort studies. The existing bivariate random-effects models, which jointly model bivariate accuracy indices (e.g., sensitivity and specificity), do not differentiate cohort studies from case-control studies and thus do not utilize the prevalence information contained in the cohort studies. The recently proposed trivariate generalized linear mixed-effects models are only applicable to cohort studies, and more importantly, they assume a common correlation structure across studies and trivariate normality on disease prevalence, test sensitivity, and specificity after transformation by some pre-specified link functions. In practice, very few studies provide justifications of these assumptions, and sometimes these assumptions are violated. In this paper, we evaluate the performance of the commonly used random-effects model under violations of these assumptions and propose a simple and robust method to fully utilize the information contained in case-control and cohort studies. The proposed method avoids making the aforementioned assumptions and can provide valid joint inferences for any functions of overall summary measures of diagnostic accuracy. Through simulation studies, we find that the proposed method is more robust to model misspecifications than the existing methods. We apply the proposed method to a meta-analysis of diagnostic test accuracy for the detection of recurrent ovarian carcinoma. Copyright © 2016 John Wiley & Sons, Ltd.

SUBMITTER: Chen Y

PROVIDER: S-EPMC6143393 | biostudies-literature | 2017 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A simple and robust method for multivariate meta-analysis of diagnostic test accuracy.

Chen Yong Y Liu Yulun Y Chu Haitao H Ting Lee Mei-Ling ML Schmid Christopher H CH

Statistics in medicine 20160831 1

Meta-analysis of diagnostic test accuracy often involves mixture of case-control and cohort studies. The existing bivariate random-effects models, which jointly model bivariate accuracy indices (e.g., sensitivity and specificity), do not differentiate cohort studies from case-control studies and thus do not utilize the prevalence information contained in the cohort studies. The recently proposed trivariate generalized linear mixed-effects models are only applicable to cohort studies, and more im ...[more]

PMID: 27580758

Similar Datasets

Project description:ImportanceRed reflex testing is a simple and inexpensive method implemented in many countries as an important part of infant screening for ocular pathologies.ObjectivesTo review the literature on the diagnostic accuracy of the red reflex test in infant screening for ocular pathologies and to perform meta-analyses to provide summary estimates.Data sourcesThe following literature databases were searched for English-language, peer-reviewed literature, published until April 19, 2020: Cochrane Central, PubMed/MEDLINE, Embase, Web of Science Core Collection, BIOSIS Previews, Current Contents Connect, Data Citation Index, Derwent Innovations Index, KCI-Korean Journal Database, Russian Science Citation Index, SciELO Citation Index, CINAHL (Cumulative Index to Nursing and Allied Health Literature), and ClinicalTrials.gov.Study selectionEligibility criteria were defined according to population (studies of consecutively screened infants), exposure (red reflex or Brückner test as the index test), comparator (any ophthalmological examination), and study type (any study with diagnostic test accuracy data).Data extraction and synthesisThe Preferred Reporting Items for Systematic Reviews and Meta-Analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) guidelines were followed. Data were extracted independently by 2 authors. For summary estimates of diagnostic test accuracy, the hierarchical summary receiver operating characteristics curve was used. Prevalence of ocular pathologies was introduced for a prevalence meta-analysis, which was then used in calculations of diagnostic accuracy of the red reflex test when applied in infant screening.Main outcomes and measuresTrue-positive, false-positive, true-negative, and false-negative findings; sensitivity; specificity; and positive and negative predictive values.ResultsIn this meta-analysis, 8713 unique infants from 5 unique studies were eligible for qualitative and quantitative review. All studies used the red reflex test without pupillary dilation and were compared with a reference test performed with pupillary dilation. For any ocular pathology, an estimated sensitivity of 7.5% (95% CI, 7.4%-7.5%) and specificity of 97.5% (95% CI, 97.5%-97.5%) was found. Focusing on ocular pathologies that required a medical or surgical intervention, sensitivity improved to 17.5% (95% CI, 0.8%-84.8%) and specificity remained high at 97.6% (95% CI, 87.7%-99.6%).Conclusions and relevanceThese findings suggest that an abnormal red reflex finding most likely reflects an underlying ocular pathology. However, a normal red reflex finding during screening does not exclude ocular disease.

Project description:Background and Aims: Cystic fibrosis-related liver disease (CFLD) is one of the leading causes of morbidity and mortality in cystic fibrosis (CF). Several non-invasive diagnostic methods have been proposed as screening tools for CFLD. Our aim was to rank all available non-invasive modalities for diagnostic performance. Methods: A systematic search was performed in five medical databases to find studies which reported on any single or composite non-invasive diagnostic test (as an index test) compared to the Debray, the EuroCare or the Colombo criteria (as a reference standard). Ranking was carried out with a Bayesian diagnostic test accuracy network meta-analysis based on superiority indices, calculated for pooled sensitivity (Se) and specificity (Sp) with a 95% confidence interval (CI). The study was registered under CRD42020155846 in PROSPERO. Results: Fifteen studies with 15 index tests and a combination of them were included. The New criteria proposed by Koh et al. - which represent a composite diagnostic definition for CFLD including liver biochemistry, ultrasonography, transient elastography and fibrosis markers-had the best performance for detecting CFLD (Se:94%[CI:58-100], Sp:72%[CI:52-84]); while transient elastography (Se:65%[CI:56-74], Sp:88%[CI:84-91]) and a combination of it with a tissue inhibitor of metalloproteinase-4 measurement (Se:78%[CI:30-100], Sp:64%[CI:18-95%]) proved to be the second and third best options, respectively. In the imaging techniques subgroup, transient elastography (Se:66%[CI:57-72], Sp:88%[CI:85-91%]), acoustic radiation force impulse in the right lobe (Se:54%[CI:33-74], Sp:88%[CI:66-96]) and that in the left lobe (Se:55%[CI:23-81], Sp:82%[CI:50-95]) were ranked the highest. Comparing biochemical markers/fibrosis indices, the measurement of the Forns index (Se:72%[CI:25-99], Sp:63%[CI:16-94]), the aspartate aminotransferase-to-platelet ratio (Se:55%[CI:41-68], Sp:83%[CI:66-89]) and alkaline phosphatase (Se:63%[CI:18-93], Sp:64%[CI:19-95]) were ranked the highest. Conclusion: The New criteria show the best diagnostic performance. In clinical practice, transient elastography seems to be a simple, cheap and non-invasive tool, outperforming imaging, biochemical and fibrosis tests for detecting CFLD. Further studies are needed to validate our findings.

Project description:Melanoma has the highest mortality rate among skin cancers, and early-diagnosis is essential to maximize survival rate. The current procedure for melanoma diagnosis is based on dermoscopy, i.e., a qualitative visual inspection of lesions with intrinsic limited diagnostic reliability and reproducibility. Other non-invasive diagnostic techniques may represent valuable solutions to retrieve additional objective information of a lesion. This review aims to compare the diagnostic performance of non-invasive techniques, alternative to dermoscopy, for melanoma detection in clinical settings. A systematic review of the available literature was performed using PubMed, Scopus and Google scholar databases (2010-September 2020). All human, in-vivo, non-invasive studies using techniques, alternative to dermoscopy, for melanoma diagnosis were included with no restriction on the recruited population. The reference standard was histology but dermoscopy was accepted only in case of benign lesions. Attributes of the analyzed studies were compared, and the quality was evaluated using CASP Checklist. For studies in which the investigated technique was implemented as a diagnostic tool (DTA studies), the QUADAS-2 tool was applied. For DTA studies that implemented a melanoma vs. other skin lesions classification task, a meta-analysis was performed reporting the SROC curves. Sixty-two references were included in the review, of which thirty-eight were analyzed using QUADAS-2. Study designs were: clinical trials (13), retrospective studies (10), prospective studies (8), pilot studies (10), multitiered study (1); the remain studies were proof of concept or had undefined study type. Studies were divided in categories based on the physical principle employed by each diagnostic technique. Twenty-nine out of thirty-eight DTA studies were included in the meta-analysis. Heterogeneity of studies' types, testing strategy, and diagnostic task limited the systematic comparison of the techniques. Based on the SROC curves, spectroscopy achieved the best performance in terms of sensitivity (93%, 95% CI 92.8-93.2%) and specificity (85.2%, 95%CI 84.9-85.5%), even though there was high concern regarding robustness of metrics. Reflectance-confocal-microscopy, instead, demonstrated higher robustness and a good diagnostic performance (sensitivity 88.2%, 80.3-93.1%; specificity 65.2%, 55-74.2%). Best practice recommendations were proposed to reduce bias in future DTA studies. Particular attention should be dedicated to widen the use of alternative techniques to conventional dermoscopy.

Project description:Muscle ultrasound is an emerging tool for diagnosing sarcopenia. This review aims to summarize the current knowledge on the diagnostic test accuracy of ultrasound for the diagnosis of sarcopenia. We collected data from Ovid Medline, Embase and the Cochrane Central Register of Controlled Trials. Diagnostic test accuracy studies using muscle ultrasound to detect sarcopenia were included. Bivariate random-effects models based on sensitivity and specificity pairs were used to calculate the pooled estimates of sensitivity, specificity and the area under the curves (AUCs) of summary receiver operating characteristic (SROC), if possible. We screened 7332 publications and included 17 studies with 2143 participants (mean age range: 52.6-82.8 years). All included studies had a high risk of bias. The study populations, reference standards and ultrasound measurement methods varied across the studies. Lower extremity muscles were commonly studied, whereas muscle thickness (MT) was the most widely measured parameter, followed by the cross-sectional area (CSA). The MTs of the gastrocnemius, rectus femoris, tibialis anterior, soleus, rectus abdominis and geniohyoid muscles showed a moderate diagnostic accuracy for sarcopenia (SROC-AUC 0.83, 8 studies; SROC-AUC 0.78, 5 studies; AUC 0.82, 1 study; AUC 0.76-0.78, 2 studies; AUC 0.76, 1 study; and AUC 0.79, 1 study, respectively), whereas the MTs of vastus intermedius, quadriceps femoris and transversus abdominis muscles showed a low diagnostic accuracy (AUC 0.67-0.71, 3 studies; SROC-AUC 0.64, 4 studies; and AUC 0.68, 1 study, respectively). The CSA of rectus femoris, biceps brachii muscles and gastrocnemius fascicle length also showed a moderate diagnostic accuracy (AUC 0.70-0.90, 3 studies; 0.81, 1 study; and 0.78-0.80, 1 study, respectively), whereas the echo intensity (EI) of rectus femoris, vastus intermedius, quadriceps femoris and biceps brachii muscles showed a low diagnostic accuracy (AUC 0.52-0.67, 2 studies; 0.48-0.50, 1 study; 0.43-0.49, 1 study; and 0.69, 1 study, respectively). The combination of CSA and EI of biceps brachii or rectus femoris muscles was better than either CSA or EI alone for diagnosing sarcopenia. Muscle ultrasound shows a low-to-moderate diagnostic test accuracy for sarcopenia diagnosis depending on different ultrasound parameters, measured muscles, reference standards and study populations. The combination of muscle quality indicators (e.g., EI) and muscle quantity indicators (e.g., MT) might provide better diagnostic test accuracy.

Dataset Information

A simple and robust method for multivariate meta-analysis of diagnostic test accuracy.

Publications

A simple and robust method for multivariate meta-analysis of diagnostic test accuracy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets