Dataset Information

Comparing the Diagnostic Accuracy of Clinician Judgment to a Novel Host Response Diagnostic for Acute Respiratory Illness.

ABSTRACT:

Background

Difficulty discriminating bacterial from viral infections drives antibacterial misuse. Host gene expression tests discriminate bacterial and viral etiologies, but their clinical utility has not been evaluated.

Methods

Host gene expression and procalcitonin levels were measured in 582 emergency department participants with suspected infection. We also recorded clinician diagnosis and clinician-recommended treatment. These 4 diagnostic strategies were compared with clinical adjudication as the reference. To estimate the clinical impact of host gene expression, we calculated the change in overall Net Benefit (∆NB; the difference in Net Benefit comparing 1 diagnostic strategy with a reference) across a range of prevalence estimates while factoring in the clinical significance of false-positive and -negative errors.

Results

Gene expression correctly classified bacterial, viral, or noninfectious illness in 74.1% of subjects, similar to the other strategies. Clinical diagnosis and clinician-recommended treatment revealed a bias toward overdiagnosis of bacterial infection resulting in high sensitivity (92.6% and 94.5%, respectively) but poor specificity (67.2% and 58.8%, respectively), resulting in a 33.3% rate of inappropriate antibacterial use. Gene expression offered a more balanced sensitivity (79.0%) and specificity (80.7%), which corresponded to a statistically significant improvement in average weighted accuracy (79.9% vs 71.5% for procalcitonin and 76.3% for clinician-recommended treatment; P<.0001 for both). Consequently, host gene expression had greater Net Benefit in diagnosing bacterial infection than clinician-recommended treatment (∆NB=6.4%) and procalcitonin (∆NB=17.4%).

Conclusions

Host gene expression-based tests to distinguish bacterial and viral infection can facilitate appropriate treatment, improving patient outcomes and mitigating the antibacterial resistance crisis.

SUBMITTER: Jaffe IS

PROVIDER: S-EPMC8651161 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Diagnostic clinical prediction rules (CPRs) are developed to improve diagnosis or decrease diagnostic testing. Whether, and in what situations diagnostic CPRs improve upon clinical judgment is unclear.We searched MEDLINE, Embase and CINAHL, with supplementary citation and reference checking for studies comparing CPRs and clinical judgment against a current objective reference standard. We report 1) the proportion of study participants classified as not having disease who hence may avoid further testing and or treatment and 2) the proportion, among those classified as not having disease, who do (missed diagnoses) by both approaches. 31 studies of 13 medical conditions were included, with 46 comparisons between CPRs and clinical judgment. In 2 comparisons (4%), CPRs reduced the proportion of missed diagnoses, but this was offset by classifying a larger proportion of study participants as having disease (more false positives). In 36 comparisons (78%) the proportion of diagnoses missed by CPRs and clinical judgment was similar, and in 9 of these, the CPRs classified a larger proportion of participants as not having disease (fewer false positives). In 8 comparisons (17%) the proportion of diagnoses missed by the CPRs was greater. This was offset by classifying a smaller proportion of participants as having the disease (fewer false positives) in 2 comparisons. There were no comparisons where the CPR missed a smaller proportion of diagnoses than clinical judgment and classified more participants as not having the disease. The design of the included studies allows evaluation of CPRs when their results are applied independently of clinical judgment. The performance of CPRs, when implemented by clinicians as a support to their judgment may be different.In the limited studies to date, CPRs are rarely superior to clinical judgment and there is generally a trade-off between the proportion classified as not having disease and the proportion of missed diagnoses. Differences between the two methods of judgment are likely the result of different diagnostic thresholds for positivity. Which is the preferred judgment method for a particular clinical condition depends on the relative benefits and harms of true positive and false positive diagnoses.

Project description:Background: Acute respiratory infections (ARIs) are the leading indication for antibacterial prescriptions despite a viral etiology in the majority of cases. The lack of available diagnostics to discriminate viral and bacterial etiologies contributes to this discordance. Recent efforts have focused on the host response as a source for novel diagnostic targets although none have explored the ability of host-derived microRNAs (miRNA) to discriminate between these etiologies. Methods: In this study, we compared host-derived miRNAs and mRNAs from human H3N2 influenza challenge subjects to those from patients with Streptococcus pneumoniae pneumonia. Sparse logistic regression models were used to generate miRNA signatures diagnostic of ARI etiologies. Generalized linear modeling of mRNAs to identify differentially expressed (DE) genes allowed analysis of potential miRNA:mRNA relationships. High likelihood miRNA:mRNA interactions were examined using binding target prediction and negative correlation to further explore potential changes in pathway regulation in response to infection. Results: The resultant miRNA signatures were highly accurate in discriminating ARI etiologies. Mean accuracy was 100% [88.8-100; 95% Confidence Interval (CI)] in discriminating the healthy state from S. pneumoniae pneumonia and 91.3% (72.0-98.9; 95% CI) in discriminating S. pneumoniae pneumonia from influenza infection. Subsequent differential mRNA gene expression analysis revealed alterations in regulatory networks consistent with known biology including immune cell activation and host response to viral infection. Negative correlation network analysis of miRNA:mRNA interactions revealed connections to pathways with known immunobiology such as interferon regulation and MAP kinase signaling. Conclusion: We have developed novel human host-response miRNA signatures for bacterial and viral ARI etiologies. miRNA host response signatures reveal accurate discrimination between S. pneumoniae pneumonia and influenza etiologies for ARI and integrated analyses of the host-pathogen interface are consistent with expected biology. These results highlight the differential miRNA host response to bacterial and viral etiologies of ARI, offering new opportunities to distinguish these entities.