Dataset Information

Benchmarked performance charts using principal components analysis to improve the effectiveness of feedback for audit data in HIV care.

ABSTRACT:

Background

Feedback tools for clinical audit data that compare site-specific results to average performance over all sites can be useful for quality improvement. Proposed tools should be simple and clearly benchmark the site's performance, so that a relevant action plan can be directly implemented to improve patient care services. We aimed to develop such a tool in order to feedback data to UK HIV clinics participating in the 2015 British HIV Association (BHIVA) audit assessing compliance with the 2011 guidelines for routine investigation and monitoring of adult HIV-1- infected individuals.

Methods

HIV clinic sites were asked to provide data on a random sample of 50-100 adult patients attending for HIV care during 2014 and/or 2015 by completing a self-audit spreadsheet. Outcomes audited included the proportion of patients with recorded resistance testing, viral load monitoring, adherence assessment, medications, hepatitis testing, vaccination management, risk assessments, and sexual health screening. For each outcome we benchmarked the proportion for a specific site against the average performance. We produced performance charts for each site using boxplots for the outcomes. We also used the mean and differences from the mean performance to produce a dashboard for each site. We used principal components analysis to group correlated outcomes and simplify the dashboard.

Results

The 106 sites included in the study provided information on a total of 7768 patients. Outcomes capturing monitoring of treatment of HIV-infection showed high performance across the sites, whereas testing for hepatitis, and risk assessment for cardiovascular disease and smoking, management of flu vaccination, sexual health screening, and cervical cytology for women were very variable across sites. The principal components analysis reduced the original 12 outcomes to four factors that represented HIV care, hepatitis testing, other screening tests, and resistance testing. These provided simplified measures of adherence to guidelines which were presented as a 4 bar dashboard of performance.

Conclusion

Our dashboard performance charts provide easily digestible visual summaries of locally relevant audit data that are benchmarked against the overall mean and can be used to improve feedback to HIV services. Feedback from clinicians indicated that they found these charts acceptable and useful.

SUBMITTER: Michael S

PROVIDER: S-EPMC5525257 | biostudies-literature | 2017 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Benchmarked performance charts using principal components analysis to improve the effectiveness of feedback for audit data in HIV care.

Michael Skevi S Gompels Mark M Sabin Caroline C Curtis Hilary H May Margaret T MT

BMC health services research 20170724 1

<h4>Background</h4>Feedback tools for clinical audit data that compare site-specific results to average performance over all sites can be useful for quality improvement. Proposed tools should be simple and clearly benchmark the site's performance, so that a relevant action plan can be directly implemented to improve patient care services. We aimed to develop such a tool in order to feedback data to UK HIV clinics participating in the 2015 British HIV Association (BHIVA) audit assessing complianc ...[more]

PMID: 28738800

Similar Datasets

Project description:BackgroundTuberculosis screening of people living with HIV (PLHIV) can contribute to early tuberculosis diagnosis and improved patient outcomes. Evidence-based guidelines for tuberculosis screening are available, but literature assessing their implementation and the quality of clinical practice is scarce.ObjectivesTo assess tuberculosis screening practices and the effectiveness of audit and performance feedback to improve quality of tuberculosis screening at HIV care clinics in Ghana.DesignHealthcare providers at 10 large HIV care clinics prospectively registered patient consultations during May and October 2014, before and after a performance feedback intervention in August 2014. The outcomes of interest were overall tuberculosis suspicion rate during consultations and provider adherence to the International Standards for Tuberculosis Care and the World Health Organizations' guidelines for symptom-based tuberculosis screening among PLHIV.ResultsTwenty-one healthcare providers registered a total of 2,666 consultations; 1,368 consultations before and 1,298 consultations after the feedback intervention. Tuberculosis suspicion rate during consultation increased from 12.6 to 20.9% after feedback (odds ratio, OR 1.83; 95% confidence interval, CI: 1.09-3.09). Before feedback, sputum smear microscopy was requested for 58.7% of patients with suspected tuberculosis, for 47.2% of patients with cough ?2 weeks, and for 27.5% of patients with a positive World Health Organization (WHO) symptom screen (any of current cough, fever, weight loss or night sweats). After feedback, patients with a positive WHO symptom screen were more likely to be suspected of tuberculosis (OR 2.21; 95% CI: 1.19-4.09) and referred for microscopy (OR 2.71; 95% CI: 1.25-5.86).ConclusionsA simple prospective audit tool identified flaws in clinical practices for tuberculosis screening of PLHIV. There was no systematic identification of people with suspected active tuberculosis. We found low initial tuberculosis suspicion rate compounded by low referral rates of relevant patients for sputum smear microscopy. Adherence to recommended standards and guidelines for tuberculosis screening improved after performance feedback.

Project description:BackgroundWe designed a continuing medical education (CME) program to teach primary care physicians (PCP) how to engage in cancer risk communication and shared decision making with patients who have limited health literacy (HL).ObjectiveWe evaluated whether training PCPs, in addition to audit-feedback, improves their communication behaviors and increases cancer screening among patients with limited HL to a greater extent than only providing clinical performance feedback.DesignFour-year cluster randomized controlled trial.ParticipantsEighteen PCPs and 168 patients with limited HL who were overdue for colorectal/breast/cervical cancer screening.InterventionsCommunication intervention PCPs received skills training that included standardized patient (SP) feedback on counseling behaviors. All PCPs underwent chart audits of patients' screening status semiannually up to 24 months and received two annual performance feedback reports.Main measuresPCPs experienced three unannounced SP encounters during which SPs rated PCP communication behaviors. We examined between-group differences in changes in SP ratings and patient knowledge of cancer screening guidelines over 12 months; and changes in patient cancer screening rates over 24 months.Key resultsThere were no group differences in SP ratings of physician communication at baseline. At follow-up, communication intervention PCPs were rated higher in general communication about cancer risks and shared decision making related to colorectal cancer screening compared to PCPs who only received performance feedback. Screening rates increased among patients of PCPs in both groups; however, there were no between-group differences in screening rates except for mammography. The communication intervention did not improve patient cancer screening knowledge.ConclusionCompared to audit and feedback alone, including PCP communication training increases PCP patient-centered counseling behaviors, but not cancer screening among patients with limited HL. Larger studies must be conducted to determine whether lack of changes in cancer screening were due to clinic/patient sample size versus ineffectiveness of communication training to change outcomes.

Project description:BackgroundAudit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator.MethodsWe described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis.ResultsWe found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies.ConclusionClinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

Project description:To decipher gene regulatory networks, we used systematic suppression of 97 transcription factors (TFs) and 7 other genes with shRNA in mouse embryonic stem (ES) cells, followed by global gene expression profiling. Meta-analysis of these data together with the earlier data obtained by the induction of 50 TFs and the existing genome-wide data on TF binding sites identified the sets of regulated target genes for 23 TFs. Principal component analysis shows different roles of two groups of TFs that are active in ES cells: Pou5f1 and Sox2 support the expression of their target genes and prevent the upregulation of trophectoderm-related genes, whereas Esrrb, Sall4, Nanog, Gbx2, Grhl2, Mtf2, Aff1, Tcfap4, and Cdc5l support the expression of targets of Esrrb, including glycolysis genes, and prevent upregulation of targets of Trp53 and Polycomb TFs. If TFs from the second group are downregulated while Pou5f1 and Sox2 are still active, then the cell state changes towards epiblast lineages. Sequences for shRNA were designed to target 3 untranslated region of genes (Supplementary Table S8). Gene expression change was checked with real time qPCR (Supplementary Figure S7) and Westerm blot. ES cells (ES[MC1R(20)], passage 20) were cultured without feeders and were co-transfected with 1.6 g of shRNA expression vector and 0.4 g of pPyCAG-EGFP-IP carrying expression cassettes for puromycin resistant genes and EGFP using Effectene (Qiagen). Transfected cells were cultured in presence of 1.5 g/ml of puromycin and were harvested at 72 h after transfection. Mock cells were treated with transfection reagent without DNA and cultured in the absence of puromycin. Experiments were done in 3 replications with 2 of them used for gene expression profiling with microarrays. Total RNA was isolated by TRIzol (Invitrogen) after 2 days. Cy3-CTP labeled sample targets were prepared with total RNA by Low RNA Input Fluorescent Linear Amplification Kit (Agilent). Cy5-CTP labeled reference target was Stratagene Universal Mouse Reference RNA. Note that the processed data in the paper, which is also attached as GSE26520_Table_data.txt.gz, is slightly different from the values columns in each sample. The original processed data are normalized with a batch method, as the new batches of arrays added in the set. The value columns in this submission reflect full normalization as described in the data processing fields in each sample.

Project description:BackgroundLaboratory tests and transfusions are sometimes ordered inappropriately, particularly in the critical care setting, which sees frequent use of both. Audit and Feedback (A&F) is a potentially useful intervention for modifying healthcare provider behaviors, but its application to the complex, team-based environment of critical care is not well understood. We conducted a systematic review of the literature on A&F interventions for improving test or transfusion ordering in the critical care setting.MethodsFive databases, two registries, and the bibliographies of relevant articles were searched. We included critical care studies that assessed the use of A&F targeting healthcare provider behaviors, alone or in combination with other interventions to improve test and transfusion ordering, as compared to historical practice, no intervention, or another healthcare behaviour change intervention. Studies were included only if they reported laboratory test or transfusion orders, or the appropriateness of orders, as outcomes. There were no restrictions based on study design, date of publication, or follow-up time. Intervention characteristics and absolute differences in outcomes were summarized. The quality of individual studies was assessed using a modified version of the Effective Practice and Organisation of Care Cochrane Review Group's criteria.ResultsWe identified 16 studies, including 13 uncontrolled before-after studies, one randomized controlled trial, one controlled before-after study, and one controlled clinical trial (quasi-experimental). These studies described 17 interventions, mostly (88%) multifaceted interventions with an A&F component. Feedback was most often provided in a written format only (41%), more than once (53%), and most often only provided data aggregated to the group-level (41%). Most studies saw a change in the hypothesized direction, but not all studies provided statistical analyses to formally test improvement. Overall study quality was low, with studies often lacking a concurrent control group.ConclusionsOur review summarizes characteristics of A&F interventions implemented in the critical care context, points to some mechanisms by which A&F might be made more effective in this setting, and provides an overview of how the appropriateness of orders was reported. Our findings suggest that A&F can be effective in the context of critical care; however, further research is required to characterize approaches that optimize the effectiveness in this setting alongside more rigorous evaluation methods.Trial registrationPROSPERO CRD42016051941.

Dataset Information

Benchmarked performance charts using principal components analysis to improve the effectiveness of feedback for audit data in HIV care.

Background

Methods

Results

Conclusion

Publications

Benchmarked performance charts using principal components analysis to improve the effectiveness of feedback for audit data in HIV care.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets