Dataset Information

Bayesian hierarchical latent class models for estimating diagnostic accuracy.

ABSTRACT: The diagnostic accuracy of a test or rater has a crucial impact on clinical decision making. The assessment of diagnostic accuracy for multiple tests or raters also merits much attention. A Bayesian hierarchical conditional independence latent class model for estimating sensitivities and specificities for a large group of tests or raters is proposed, which is applicable to both with-gold-standard and without-gold-standard situations. Through the hierarchical structure, not only are the sensitivities and specificities of individual tests estimated, but also the diagnostic performance of the whole group of tests. For a small group of tests or raters, the proposed model is further extended by introducing pairwise covariances between tests to improve the fitting and to allow for more modeling flexibility. Correlation residual analysis is applied to detect any significant covariance between multiple tests. Just Another Gibbs Sampler (JAGS) implementation is efficiently adopted for both models. Three real data sets from literature are analyzed to explicitly illustrate the proposed methods.

SUBMITTER: Wang C

PROVIDER: S-EPMC6884669 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Bayesian hierarchical latent class models for estimating diagnostic accuracy.

Wang Chunling C Lin Xiaoyan X Nelson Kerrie P KP

Statistical methods in medical research 20190530 4

The diagnostic accuracy of a test or rater has a crucial impact on clinical decision making. The assessment of diagnostic accuracy for multiple tests or raters also merits much attention. A Bayesian hierarchical conditional independence latent class model for estimating sensitivities and specificities for a large group of tests or raters is proposed, which is applicable to both with-gold-standard and without-gold-standard situations. Through the hierarchical structure, not only are the sensitivi ...[more]

PMID: 31146651

Similar Datasets

Project description:BackgroundTyphoid fevers are infections caused by the bacteria Salmonella enterica serovar Typhi (Salmonella Typhi) and Paratyphi A, B and C (Salmonella Paratyphi). Approximately 17.8 million incident cases of typhoid fever occur annually, and incidence is highest in children. The accuracy of current diagnostic tests of typhoid fever is poorly understood. We aimed to determine the comparative accuracy of available tests for the pediatric population.MethodsWe first conducted a systematic literature review to identify studies that compared diagnostic tests for typhoid fever in children (aged ≤15 years) to blood culture results. We applied a Bayesian latent-class extension to a network meta-analysis model. We modelled known diagnostic properties of bone marrow culture and the relationship between bone marrow and blood culture as informative priors in a Bayesian framework. We tested sensitivities for the proportion of negative blood samples that were false as well as bone marrow sensitivity and specificity.ResultsWe found 510 comparisons from 196 studies and 57 specific to the pediatric population. IgM-based tests outperformed their IgG-based counterparts for ELISA and Typhidot tests. The lateral flow IgG test performed comparatively well with 92% sensitivity (72% to 98% across scenario analyses) and 94% specificity. The most sensitive test of those investigated for the South Asian pediatric population was the Reverse Passive Hemagglutination Assay with 99% sensitivity (98% - 100% across scenario analyses). Adding a Widal slide test to other typhoid diagnostics did not substantially improve diagnostic performance beyond the single test alone, however, a lateral flow-based IgG rapid test combined with the typhoid/paratyphoid (TPT) assay yielded improvements in sensitivity without substantial declines in specificity and was the best performing combination test in this setting.ConclusionIn the pediatric population, lateral-flow IgG, TPT and Reverse Passive Hemagglutination tests had high diagnostic accuracy compared to other diagnostics. Combinations of tests may provide a feasible option to increase diagnostic sensitivity. South Asia has the most informed set of data on typhoid diagnostic testing accuracy, and the evidence base in other important regions needs to be expanded.

Project description:AimsThe main focus of this study is to illustrate the importance of the statistical analysis in the evaluation of the accuracy of malaria diagnostic tests, without admitting a reference test, exploring a dataset (n=3317) collected in São Tomé and Príncipe.MethodsBayesian Latent Class Models (without and with constraints) are used to estimate the malaria infection prevalence, together with sensitivities, specificities, and predictive values of three diagnostic tests (RDT, Microscopy and PCR), in four subpopulations simultaneously based on a stratified analysis by age groups (< 5, ≥ 5 years old) and fever status (febrile, afebrile).ResultsIn the afebrile individuals with at least five years old, the posterior mean of the malaria infection prevalence is 3.2% with a highest posterior density interval of [2.3-4.1]. The other three subpopulations (febrile ≥ 5 years, afebrile or febrile children less than 5 years) present a higher prevalence around 10.3% [8.8-11.7]. In afebrile children under-five years old, the sensitivity of microscopy is 50.5% [37.7-63.2]. In children under-five, the estimated sensitivities/specificities of RDT are 95.4% [90.3-99.5]/93.8% [91.6-96.0]--afebrile--and 94.1% [87.5-99.4]/97.5% [95.5-99.3]--febrile. In individuals with at least five years old are 96.0% [91.5-99.7]/98.7% [98.1-99.2]--afebrile--and 97.9% [95.3-99.8]/97.7% [96.6-98.6]--febrile. The PCR yields the most reliable results in four subpopulations.ConclusionsThe utility of this RDT in the field seems to be relevant. However, in all subpopulations, data provide enough evidence to suggest caution with the positive predictive values of the RDT. Microscopy has poor sensitivity compared to the other tests, particularly, in the afebrile children less than 5 years. This type of findings reveals the danger of statistical analysis based on microscopy as a reference test. Bayesian Latent Class Models provide a powerful tool to evaluate malaria diagnostic tests, taking into account different groups of interest.

Project description:ObjectivePrevious studies on diagnostic accuracy of dipstick testing for leukocyte esterase (LE) and nitrite to diagnose urinary tract infection (UTI) had used urine culture, which is an imperfect gold standard. Estimates of diagnostic accuracy obtained using the classical gold standard framework might not reflect the true diagnostic accuracy of dipstick tests.MethodsWe used the dataset from a prospective, observational study conducted in the emergency department of a teaching hospital in southern India. Patients with a clinical suspicion of UTI underwent dipstick testing for LE and nitrite, urine microscopy, and urine culture. Based on the results of urine microscopy and culture, UTI was classified into definite, probable, and possible. Patients with microscopic pyuria and a positive urine culture were adjudicated as definite UTI. Unequivocal imaging evidence of emphysematous pyelonephritis or perinephric collections was also considered definite UTI. We estimated the diagnostic accuracy of LE and nitrite tests using the classical analysis (assuming definite UTI as gold standard) and two different Bayesian latent class models (LCMs; 3-tests in 1-population and 2-tests in 2-populations models).ResultsWe studied 149 patients. Overall, 64 (43%) patients had definite, 76 (51%) had probable, and 2 (1.3%) had possible UTI; 7 (4.6%) had alternate diagnoses. In classical analysis, LE was more sensitive than nitrite (87.5% versus 70.5%), while nitrite was more specific (24% versus 58%). The 3-tests in 1-population Bayesian LCM indicated a substantially better sensitivity and specificity for LE (98.1% and 47.6%) and nitrite (88.2% and 97.7%). True sensitivity and specificity of urine culture as estimated by the model was 48.7% and 73.0%. Estimates of the 2-tests in 2-populations model were in agreement with the 3-tests in 1-population model.ConclusionsBayesian LCMs indicate a clinically important improvement in the true diagnostic accuracy of urine dipstick testing for LE and nitrite. Given this, a negative dipstick LE would rule-out UTI, while a positive dipstick nitrite would rule-in UTI in our study setting. True diagnostic accuracy of urine dipstick testing for UTI in various practice settings needs reevaluation using Bayesian LCMs.

Dataset Information

Bayesian hierarchical latent class models for estimating diagnostic accuracy.

Publications

Bayesian hierarchical latent class models for estimating diagnostic accuracy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets