Dataset Information

Effect of data quality improvement intervention on health management information system data accuracy: An interrupted time series analysis.

ABSTRACT: BACKGROUND:As part of a partnership between the Institute for Healthcare Improvement and the Ethiopian Federal Ministry of Health, woreda-based quality improvement collaboratives took place between November 2016 and December 2017 aiming to accelerate reduction of maternal and neonatal mortality in Lemu Bilbilu, Tanqua Abergele and Duguna Fango woredas. Before starting the collaboratives, assessments found inaccuracies in core measures obtained from Health Management Information System reports. METHODS AND RESULTS:Building on the quality improvement collaborative design, data quality improvement activities were added and we used the World Health Organization review methodology to drive a verification factor for the core measures of number of pregnant women that received their first antenatal care visit, number of pregnant women that received antenatal care on at least four visits, number of pregnant women tested for syphilis and number of births attended by skilled health personnel. Impact of the data quality improvement was assessed using interrupted time series analysis. We found accurate data across all time periods for Tanqua Abergele. In Lemu Bilbilu and Duguna Fango, data quality improved for all core metrics over time. In Duguna Fango, the verification factor for number of pregnant women that received their first antenatal care visit improved from 0.794 (95%CI 0.753, 0.836; p<0.001) pre-intervention by 0.173 (95%CI 0.128, 0.219; p<0.001) during the collaborative; and the verification factor for number of pregnant women tested for syphilis improved from 0.472 (95%CI 0.390, 0.554; p<0.001) pre-intervention by 0.460 (95%CI 0.369, 0.552; p<0.001) during the collaborative. In Lemu Bilbilu, the verification factor for number of pregnant women receiving a fourth antenatal visit rose from 0.589 (95%CI 0.513, 0.664; p<0.001) at baseline by 0.358 (95%CI 0.258, 0.458; p<0.001) post-intervention; and skilled birth attendance rose from 0.917 (95%CI 0.869, 0.965) at baseline by 0.083 (95%CI 0.030, 0.136; p<0.001) during the collaborative. CONCLUSIONS:A Data quality improvement initiative embedded within woreda clinical improvement collaborative improved accuracy of data used to monitor maternal and newborn health services in Ethiopia.

SUBMITTER: Mulissa Z

PROVIDER: S-EPMC7428163 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effect of data quality improvement intervention on health management information system data accuracy: An interrupted time series analysis.

Mulissa Zewdie Z Wendrad Naod N Bitewulign Befikadu B Biadgo Abera A Abate Mehiret M Alemu Haregeweyni H Abate Biruk B Kiflie Abiyou A Magge Hema H Parry Gareth G

PloS one 20200814 8

<h4>Background</h4>As part of a partnership between the Institute for Healthcare Improvement and the Ethiopian Federal Ministry of Health, woreda-based quality improvement collaboratives took place between November 2016 and December 2017 aiming to accelerate reduction of maternal and neonatal mortality in Lemu Bilbilu, Tanqua Abergele and Duguna Fango woredas. Before starting the collaboratives, assessments found inaccuracies in core measures obtained from Health Management Information System re ...[more]

PMID: 32797091

Similar Datasets

Project description:IntroductionIn low-income countries, Surgical Site Infection (SSI) is a common form of hospital-acquired infection. Antibiotic prophylaxis is an effective method of preventing these infections, if given immediately before the start of surgery. Although several studies in Africa have compared pre-operative versus post-operative prophylaxis, there are no studies describing the implementation of policies to improve prescribing of surgical antibiotic prophylaxis in African hospitals.MethodsWe conducted SSI surveillance at a typical Government hospital in Kenya over a 16 month period between August 2010 and December 2011, using standard definitions of SSI and the extent of contamination of surgical wounds. As an intervention, we developed a hospital policy that advised pre-operative antibiotic prophylaxis and discouraged extended post-operative antibiotics use. We measured process, outcome and balancing effects of this intervention in using an interrupted time series design.ResultsFrom a starting point of near-exclusive post-operative antibiotic use, after policy introduction in February 2011 there was rapid adoption of the use of pre-operative antibiotic prophylaxis (60% of operations at 1 week; 98% at 6 weeks) and a substantial decrease in the use of post-operative antibiotics (40% of operations at 1 week; 10% at 6 weeks) in Clean and Clean-Contaminated surgery. There was no immediate step-change in risk of SSI, but overall, there appeared to be a moderate reduction in the risk of superficial SSI across all levels of wound contamination. There were marked reductions in the costs associated with antibiotic use, the number of intravenous injections performed and nursing time spent administering these.ConclusionImplementation of a locally developed policy regarding surgical antibiotic prophylaxis is an achievable quality improvement target for hospitals in low-income countries, and can lead to substantial benefits for individual patients and the institution.

Project description:Blood culture contamination is a common problem in the emergency department (ED) that leads to unnecessary patient morbidity and health care costs. The study objective was to develop and evaluate the effectiveness of a quality improvement (QI) intervention for reducing blood culture contamination in an ED.The authors developed a QI intervention to reduce blood culture contamination in the ED and then evaluated its effectiveness in a prospective interrupted times series study. The QI intervention involved changing the technique of blood culture specimen collection from the traditional clean procedure to a new sterile procedure, with standardized use of sterile gloves and a new materials kit containing a 2% chlorhexidine skin antisepsis device, a sterile fenestrated drape, a sterile needle, and a procedural checklist. The intervention was implemented in a university-affiliated ED and its effect on blood culture contamination evaluated by comparing the biweekly percentages of blood cultures contaminated during a 48-week baseline period (clean technique) and 48-week intervention period (sterile technique), using segmented regression analysis with adjustment for secular trends and first-order autocorrelation. The goal was to achieve and maintain a contamination rate below 3%.During the baseline period, 321 of 7,389 (4.3%) cultures were contaminated, compared to 111 of 6,590 (1.7%) during the intervention period (p < 0.001). In the segmented regression model, the intervention was associated with an immediate 2.9% (95% confidence interval [CI] = 2.2% to 3.2%) absolute reduction in contamination. The contamination rate was maintained below 3% during each biweekly interval throughout the intervention period.A QI assessment of ED blood culture contamination led to development of a targeted intervention to convert the process of blood culture collection from a clean to a fully sterile procedure. Implementation of this intervention led to an immediate and sustained reduction of contamination in an ED with a high baseline contamination rate.

Project description:BACKGROUND:When randomisation is not possible, interrupted time series (ITS) design has increasingly been advocated as a more robust design to evaluating health system quality improvement (QI) interventions given its ability to control for common biases in healthcare QI. However, there is a potential risk of producing misleading results when this rather robust design is not used appropriately. We performed a methodological systematic review of the literature to investigate the extent to which the use of ITS has followed best practice standards and recommendations in the evaluation of QI interventions. METHODS:We searched multiple databases from inception to June 2018 to identify QI intervention studies that were evaluated using ITS. There was no restriction on date, language and participants. Data were synthesised narratively using appropriate descriptive statistics. The risk of bias for ITS studies was assessed using the Cochrane Effective Practice and Organisation of Care standard criteria. The systematic review protocol was registered in PROSPERO (registration number: CRD42018094427). RESULTS:Of 4061 potential studies and 2028 unique records screened for inclusion, 120 eligible studies assessed eight QI strategies and were from 25 countries. Most studies were published since 2010 (86.7%), reported data using monthly interval (71.4%), used ITS without a control (81%) and modelled data using segmented regression (62.5%). Autocorrelation was considered in 55% of studies, seasonality in 20.8% and non-stationarity in 8.3%. Only 49.2% of studies specified the ITS impact model. The risk of bias was high or very high in 72.5% of included studies and did not change significantly over time. CONCLUSIONS:The use of ITS in the evaluation of health system QI interventions has increased considerably over the past decade. However, variations in methodological considerations and reporting of ITS in QI remain a concern, warranting a need to develop and reinforce formal reporting guidelines to improve its application in the evaluation of health system QI interventions.

Project description:BackgroundDetailed intervention descriptions and robust evaluations that test intervention impact--and explore reasons for impact--are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the development, delivery, and evaluation of a tailored intervention designed to increase primary health care professionals' adoption of a national recommendation that women with mild to moderate postnatal depression (PND) are referred for psychological therapy as a first stage treatment.MethodsThree factors influencing referral for psychological treatment were targeted using three related intervention components: a tailored educational meeting, a tailored educational leaflet, and changes to an electronic system data template used by health professionals during consultations for PND. Evaluation comprised time series analysis of monthly audit data on percentage referral rates and monthly first prescription rates for anti-depressants. Interviews were conducted with a sample of health professionals to explore their perceptions of the intervention components and to identify possible factors influencing intervention effectiveness.ResultsThe intervention was associated with a significant, immediate, positive effect upon percentage referral rates for psychological treatments. This effect was not sustained over the ten month follow-on period. Monthly rates of anti-depressant prescriptions remained consistently high after the intervention. Qualitative interview findings suggest key messages received from the intervention concerned what appropriate antidepressant prescribing is, suggesting this to underlie the lack of impact upon prescribing rates. However, an understanding that psychological treatment can have long-term benefits was also cited. Barriers to referral identified before intervention were cited again after the intervention, suggesting the intervention had not successfully tackled the barriers targeted.ConclusionA time series design allowed the initial and sustained impact of our intervention to be tested. Combined with qualitative interviews, this provided insight into intervention effectiveness. Future research should test factors influencing intervention sustainability, and promote adoption of the targeted behavior and dis-adoption of competing behaviors where appropriate.

Project description:BackgroundWe previously reported on a randomised trial demonstrating the effectiveness and cost-effectiveness of a pharmacist-led information technology intervention (PINCER). We sought to investigate whether PINCER was effective in reducing hazardous prescribing when rolled out at scale in UK general practices.Methods and findingsWe used a multiple interrupted time series design whereby successive groups of general practices received the PINCER intervention between September 2015 and April 2017. We used 11 prescribing safety indicators to identify potentially hazardous prescribing and collected data over a maximum of 16 quarterly time periods. The primary outcome was a composite of all the indicators; a composite for indicators associated with gastrointestinal (GI) bleeding was also reported, along with 11 individual indicators of hazardous prescribing. Data were analysed using logistic mixed models for the quarterly event numbers with the appropriate denominator, and calendar time included as a covariate. PINCER was implemented in 370 (94.1%) of 393 general practices covering a population of almost 3 million patients in the East Midlands region of England; data were successfully extracted from 343 (92.7%) of these practices. For the primary composite outcome, the PINCER intervention was associated with a decrease in the rate of hazardous prescribing of 16.7% (adjusted odds ratio (aOR) 0.83, 95% confidence interval (CI) 0.80 to 0.86) at 6 months and 15.3% (aOR 0.85, 95% CI 0.80 to 0.90) at 12 months postintervention. The unadjusted rate of hazardous prescribing reduced from 26.4% (22,503 patients in the numerator/853,631 patients in the denominator) to 20.1% (11,901 patients in the numerator/591,364 patients in the denominator) at 6 months and 19.1% (3,868 patients in the numerator/201,992 patients in the denominator). The greatest reduction in hazardous prescribing associated with the intervention was observed for the indicators associated with GI bleeding; for the GI composite indicator, there was a decrease of 23.9% at both 6 months (aOR 0.76, 95% CI 0.73 to 0.80) and 12 months (aOR 0.76, 95% CI 0.70 to 0.82) postintervention. The unadjusted rate of hazardous prescribing reduced from 31.4 (16,185 patients in the numerator/515,879 patients in the denominator) to 21.2% (7,607 patients in the numerator/358,349 patients in the denominator) at 6 months and 19.5% (2,369 patients in the numerator/121,534 patients in the denominator). We adjusted for calendar time and practice, but since this was an observational study, the findings may have been influenced by unknown confounding factors or behavioural changes unrelated to the PINCER intervention. Data were also not collected for all practices at 6 months and 12 months postintervention.ConclusionsThe PINCER intervention, when rolled out at scale in routine clinical practice, was associated with a reduction in hazardous prescribing by 17% and 15% at 6 and 12 months postintervention. The greatest reductions in hazardous prescribing were for indicators associated with risk of GI bleeding. These findings support the wider national rollout of PINCER in England.

Project description:BackgroundNon-pharmacological interventions including physical activity programmes, occupational therapy and caregiver education programmes have been shown to lead to better outcomes for people with dementia and their care partners. Yet, there are gaps between what is recommended in guidelines and what happens in practice. The aim of this study was to bring together clinicians working in dementia care and establish a quality improvement collaborative. The aim of the quality improvement collaborative was to increase self-reported guideline adherence to three guideline recommendations.MethodsInterrupted time series. We recruited health professionals from community, hospital and aged care settings across Australia to join the collaborative. Members of the collaborative participated in a start-up meeting, completed an online learning course with clinical and quality improvement content, formed a quality improvement plan which was reviewed by a team of experts, received feedback following an audit of their current practice and were able to share experiences with their peers. The primary outcome was self-reported adherence to their guideline recommendation of interest which was measured using checklists. Data were collected monthly over a period of 18 months, and the study used an interrupted time series design and multilevel Poisson regression analysis to evaluate changes in self-reported adherence.ResultsA total of 45 health professionals (78% therapists) from different sites joined the collaborative and 28 completed all requirements. Data from 1717 checklists were included in the analyses. Over the duration of the project, there was a significant increase in clinician self-reported adherence to guideline recommendations with a 42.1% immediate increase in adherence (incidence rate ratio = 1.42; 95% confidence interval = 1.08-1.87; p = 0.012).ConclusionHealth professionals working with people with dementia are interested in and willing to join a quality improvement collaborative with the goal of improving non-pharmacological aspects of care. Participation in the collaborative improved the quality of care for people with dementia as measured through self-reported adherence to guideline recommendations. Although there are challenges in implementation of guideline recommendations within dementia care, the quality improvement collaborative method was considered successful. A strength was that it equipped and empowered clinicians to lead improvement activities and allowed for heterogeneity in terms of service and setting.Trial registrationACTRN12618000268246.

Dataset Information

Effect of data quality improvement intervention on health management information system data accuracy: An interrupted time series analysis.

Publications

Effect of data quality improvement intervention on health management information system data accuracy: An interrupted time series analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets