Dataset Information

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data.

ABSTRACT:

Background

In assessing quality of care in developing countries, retrospectively collected data are usually used given their availability. Retrospective data however suffer from such biases as recall bias and non-response bias. Comparing results obtained using prospectively and retrospectively collected data will help validate the use of the easily available retrospective data in assessing quality of care in past and future studies.

Methods

Prospective and retrospective datasets were obtained from a cluster randomized trial of a multifaceted intervention aimed at improving paediatric inpatient care conducted in eight rural Kenyan district hospitals by improving management of children admitted with pneumonia, malaria and diarrhea and/or dehydration. Four hospitals received a full intervention and four a partial intervention. Data were collected through 3 two weeks surveys conducted at baseline, after 6 and 18 months. Retrospective data was sampled from paediatric medical records of patients discharged in the preceding six months of the survey while prospective data was collected from patients discharged during the two week period of each survey. Risk Differences during post-intervention period of 16 quality of care indicators were analyzed separately for prospective and retrospective datasets and later plotted side by side for comparison.

Results

For the prospective data there was strong evidence of an intervention effect for 8 of the indicators and weaker evidence of an effect for one indicator, with magnitude of effect sizes varying from 23% to 60% difference. For the retrospective data, 10 process (these include the 8 indicators found to be statistically significant in prospective data analysis) indicators had statistically significant differences with magnitude of effects varying from 10% to 42%. The bar-graph comparing results from the prospective and retrospective datasets showed similarity in terms of magnitude of effects and statistical significance for all except two indicators.

Conclusion

Multifaceted interventions can help improve adoption of clinical guidelines and hence improve the quality of care. The similar inference reached after analyses based on prospective assessment of case management is a useful finding as it supports the utility of work based on examination of retrospectively assembled case records allowing longer time periods to be studied while constraining costs.

Trial registration

Current Controlled Trials ISRCTN42996612. Trial registration date: 20/11/2008.

SUBMITTER: Mwaniki P

PROVIDER: S-EPMC4110369 | biostudies-literature | 2014 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data.

Mwaniki Paul P Ayieko Philip P Todd Jim J English Mike M

BMC health services research 20140718

<h4>Background</h4>In assessing quality of care in developing countries, retrospectively collected data are usually used given their availability. Retrospective data however suffer from such biases as recall bias and non-response bias. Comparing results obtained using prospectively and retrospectively collected data will help validate the use of the easily available retrospective data in assessing quality of care in past and future studies.<h4>Methods</h4>Prospective and retrospective datasets w ...[more]

PMID: 25035114

Similar Datasets

Project description:BackgroundIn developing countries referral of severely ill children from primary care to district hospitals is common, but hospital care is often of poor quality. However, strategies to change multiple paediatric care practices in rural hospitals have rarely been evaluated.Methods and findingsThis cluster randomized trial was conducted in eight rural Kenyan district hospitals, four of which were randomly assigned to a full intervention aimed at improving quality of clinical care (evidence-based guidelines, training, job aides, local facilitation, supervision, and face-to-face feedback; n? =? 4) and the remaining four to control intervention (guidelines, didactic training, job aides, and written feedback; n ?=? 4). Prespecified structure, process, and outcome indicators were measured at baseline and during three and five 6-monthly surveys in control and intervention hospitals, respectively. Primary outcomes were process of care measures, assessed at 18 months postbaseline. In both groups performance improved from baseline. Completion of admission assessment tasks was higher in intervention sites at 18 months (mean? =? 0.94 versus 0.65, adjusted difference 0.54 [95% confidence interval 0.05-0.29]). Uptake of guideline recommended therapeutic practices was also higher within intervention hospitals: adoption of once daily gentamicin (89.2% versus 74.4%; 17.1% [8.04%-26.1%]); loading dose quinine (91.9% versus 66.7%, 26.3% [-3.66% to 56.3%]); and adequate prescriptions of intravenous fluids for severe dehydration (67.2% versus 40.6%; 29.9% [10.9%-48.9%]). The proportion of children receiving inappropriate doses of drugs in intervention hospitals was lower (quinine dose >40 mg/kg/day; 1.0% versus 7.5%; -6.5% [-12.9% to 0.20%]), and inadequate gentamicin dose (2.2% versus 9.0%; -6.8% [-11.9% to -1.6%]).ConclusionsSpecific efforts are needed to improve hospital care in developing countries. A full, multifaceted intervention was associated with greater changes in practice spanning multiple, high mortality conditions in rural Kenyan hospitals than a partial intervention, providing one model for bridging the evidence to practice gap and improving admission care in similar settings.

Project description:It is increasingly appreciated that the interpretation of health systems research studies is greatly facilitated by detailed descriptions of study context and the process of intervention. We have undertaken an 18-month hospital-based intervention study in Kenya aiming to improve care for admitted children and newborn infants. Here we describe the baseline characteristics of the eight hospitals as environments receiving the intervention, as well as the general and local health system context and its evolution over the 18 months.Hospital characteristics were assessed using previously developed tools assessing the broad structure, process, and outcome of health service provision for children and newborns. Major health system or policy developments over the period of the intervention at a national level were documented prospectively by monitoring government policy announcements, the media, and through informal contacts with policy makers. At the hospital level, a structured, open questionnaire was used in face-to-face meetings with senior hospital staff every six months to identify major local developments that might influence implementation. These data provide an essential background for those seeking to understand the generalisability of reports describing the intervention's effects, and whether the intervention plausibly resulted in these effects.Hospitals had only modest capacity, in terms of infrastructure, equipment, supplies, and human resources available to provide high-quality care at baseline. For example, hospitals were lacking between 30 to 56% of items considered necessary for the provision of care to the seriously ill child or newborn. An increase in spending on hospital renovations, attempts to introduce performance contracts for health workers, and post-election violence were recorded as examples of national level factors that might influence implementation success generally. Examples of factors that might influence success locally included frequent and sometimes numerous staff changes, movements of senior departmental or administrative staff, and the presence of local 'donor' partners with alternative priorities.The effectiveness of interventions delivered at hospital level over periods realistically required to achieve change may be influenced by a wide variety of factors at national and local levels. We have demonstrated how dynamic such contexts are, and therefore the need to consider context when interpreting an intervention's effectiveness.

Project description:We have reported the results of a cluster randomized trial of rural Kenyan hospitals evaluating the effects of an intervention to introduce care based on best-practice guidelines. In parallel work we described the context of the study, explored the process and perceptions of the intervention, and undertook a discrete study on health worker motivation because this was felt likely to be an important contributor to poor performance in Kenyan public sector hospitals. Here, we use data from these multiple studies and insights gained from being participants in and observers of the intervention process to provide our explanation of how intervention effects were achieved as part of an effort to better understand implementation in low-income hospital settings.Initial hypotheses were generated to explain the variation in intervention effects across place, time, and effect measure (indicator) based on our understanding of theory and informed by our implementation experience and participant observations. All data sources available for hospitals considered as cases for study were then examined to determine if hypotheses were supported, rejected, or required modification. Data included transcriptions of interviews and group discussions, field notes and that from the detailed longitudinal quantitative investigation. Potentially useful explanatory themes were identified, discussed by the implementing and research team, revised, and merged as part of an iterative process aimed at building more generic explanatory theory. At the end of this process, findings were mapped against a recently reported comprehensive framework for implementation research.A normative re-educative intervention approach evolved that sought to reset norms and values concerning good practice and promote 'grass-roots' participation to improve delivery of correct care. Maximal effects were achieved when this strategy and external support supervision helped create a soft-contract with senior managers clarifying roles and expectations around desired performance. This, combined with the support of facilitators acting as an expert resource and 'shop-floor' change agent, led to improvements in leadership, accountability, and resource allocation that enhanced workers' commitment and capacity and improved clinical microsystems. Provision of correct care was then particularly likely if tasks were simple and a good fit to existing professional routines. Our findings were in broad agreement with those defined as part of recent work articulating a comprehensive framework for implementation research.Using data from multiple studies can provide valuable insight into how an intervention is working and what factors may explain variability in effects. Findings clearly suggest that major intervention strategies aimed at improving child and newborn survival in low-income settings should go well beyond the fixed inputs (training, guidelines, and job aides) that are typical of many major programmes. Strategies required to deliver good care in low-income settings should recognize that this will need to be co-produced through engagement often over prolonged periods and as part of a directive but adaptive, participatory, information-rich, and reflective process.

Project description:There is a growing emphasis on the need to tackle inadequate human resources for health (HRH) as an essential part of strengthening health systems; but the focus is mostly on macro-level issues, such as training, recruitment, skill mix and distribution. Few attempts have been made to understand the capability of health workers, their motivation and other structural and organizational aspects of systems that influence workforce performance. We have examined literature on the roles of mid-level managers to help us understand how they might influence service delivery quality in Kenyan hospitals. In the Kenyan hospital settings, these are roles that head of departments who are also clinical or nursing service providers might play.A computerized search strategy was run in Pub Med, Cochrane Library, Directory of Open Access Journals Social Science Research Network, Eldis, Google Scholar and Human Resources for Health web site databases using both free-text and MeSH terms from 1980 to 2011. In addition, citation searching from excluded and included articles was used and relevant unpublished literature systematically identified.A total of 23 articles were finally included in the review from over 7000 titles and abstracts initially identified. The most widely documented roles of mid-level managers were decision-making or problem-solving, strategist or negotiator and communicator. Others included being a therapist or motivator, goal setting or articulation and mentoring or coaching. In addition to these roles, we identified important personal attributes of a good manager, which included interpersonal skills, delegation and accountability, and honesty. The majority of studies included in the review concerned the roles that mid-level managers are expected to play in times of organizational change.This review highlights the possible significance of mid-level managers in achieving delivery of high-quality services in Kenyan public hospitals and strongly suggests that approaches to strengthen this level of management will be valuable. The findings from this review should also help inform empirical studies of the roles of mid-level managers in these settings.

Project description:BackgroundMeasuring the quality of hospital admission care is essential to ensure that standards of practice are met and continuously improved to reduce morbidity and mortality associated with the illnesses most responsible for inpatient deaths. The Paediatric Admission Quality of Care (PAQC) score is a tool for measuring adherence to guidelines for children admitted with acute illnesses in a low-income setting. We aimed to explore the external and criterion-related validity of the PAQC score by investigating its association with mortality using data drawn from a diverse sample of Kenyan hospitals.MethodsWe identified children admitted to Kenyan hospitals for treatment of malaria, pneumonia, diarrhoea, or dehydration from datasets from three sources: an observational study, a clinical trial, and a national cross-sectional survey. We extracted variables describing the process of care provided to patients at admission and their eventual outcomes from these data. We applied the PAQC scoring algorithm to the data to obtain a quality-of-care score for each child. We assessed external validity of the PAQC score by its systematic replication in datasets that had not been previously used to investigate properties of the PAQC score. We assessed criterion-related validity by using hierarchical logistic regression to estimate the association between PAQC score and the outcome of mortality, adjusting for other factors thought to be predictive of the outcome or responsible for heterogeneity in quality of care.FindingsWe found 19?065 eligible admissions in the three validation datasets that covered 27 hospitals, of which 12?969 (68%) were complete cases. Greater guideline adherence, corresponding to higher PAQC scores, was associated with a reduction in odds of death across the three datasets, ranging between 9% (odds ratio 0·91, 95% CI 0·84-0·99; p=0·031) and 30% (0·70, 0·63-0·78; p<0·0001) adjusted reduction per unit increase in the PAQC score, with a pooled estimate of 17% (0·83, 0·78-0·89; p<0·0001). These findings were consistent with a multiple imputation analysis that used information from all observations in the combined dataset.InterpretationThe PAQC score, designed as an index of the technical quality of care for the three commonest causes of admission in children, is also associated with mortality. This finding suggests that it could be a meaningful summary measure of the quality of care for common inpatient conditions and supports a link between process quality and outcome. It might have potential for application in low-income countries with similar disease profiles and in which paediatric practice recommendations are based on WHO guidelines.FundingThe Wellcome Trust.

Project description:BackgroundDistrict hospital services in Kenya and many low-income countries should deliver proven, effective interventions that could substantially reduce child and newborn mortality. However such services are often of poor quality. Researchers have therefore been challenged to identify intervention strategies that go beyond addressing knowledge, skill, or resource inadequacies to support health systems to deliver better services at scale. An effort to develop a system-oriented intervention tailored to local needs and context and drawing on theory is described.MethodsAn intervention was designed to improve district hospital services for children based on four main strategies: a reflective process to distill root causes for the observed problems with service delivery; developing a set of possible intervention approaches to address these problems; a search of literature for theory that provided the most appropriate basis for intervention design; and repeatedly moving backwards and forwards between identified causes, proposed interventions, identified theory, and knowledge of the existing context to develop an overarching intervention that seemed feasible and likely to be acceptable and potentially sustainable.Results and discussionIn addition to human and resource constraints key problems included failures of relevant professionals to take responsibility for or ownership of the challenge of pediatric service delivery; inadequately prepared, poorly supported leaders of service units (mid-level managers) who are often professionally and geographically isolated and an almost complete lack of useful information for routinely monitoring or understanding service delivery practice or outcomes. A system-oriented intervention recognizing the pivotal role of leaders of service units but addressing the outer and inner setting of hospitals was designed to help shape and support an appropriate role for these professionals. It aims to foster a sense of ownership while providing the necessary understanding, knowledge, and skills for mid-level managers to work effectively with senior managers and frontline staff to improve services. The intervention will include development of an information system, feedback mechanisms, and discussion fora that promote positive change. The vehicle for such an intervention is a collaborative network partnering government and national professional associations. This case is presented to promote discussion on approaches to developing context appropriate interventions particularly in international health.

Project description:The first case of severe acute respiratory coronavirus 2 (SARS-CoV-2) was identified in March 2020 in Kenya resulting in the implementation of public health measures (PHM) to prevent large-scale epidemics. We aimed to quantify the impact of COVID-19 confinement measures on access to inpatient services using data from 204 Kenyan hospitals. Data on monthly admissions and deliveries from the District Health Information Software version 2 (DHIS 2) were extracted for the period January 2018 to March 2021 stratified by hospital ownership (public or private) and adjusting for missing data using multiple imputation (MI). We used the COVID-19 event as a natural experiment to examine the impact of COVID-19 and associated PHM on use of health services by hospital ownership. We estimated the impact of COVID-19 using two approaches; Statistical process control (SPC) charts to visualize and detect changes and Interrupted time series (ITS) analysis using negative-binomial segmented regression models to quantify the changes after March 2020. Sensitivity analysis was undertaken to test robustness of estimates using Generalised Estimating Equations (GEE) and impact of national health workers strike on observed trends. SPC charts showed reductions in most inpatient services starting April 2020. ITS modelling showed significant drops in April 2020 in monthly volumes of live-births (11%), over-fives admissions for medical (29%) and surgical care (25%) with the greatest declines in the under-five's admissions (59%) in public hospitals. Similar declines were apparent in private hospitals. Health worker strikes had a significant impact on post-COVID-19 trends for total deliveries, live-births and caesarean section rate in private hospitals. COVID-19 has disrupted utilization of inpatient services in Kenyan hospitals. This might have increased avoidable morbidity and mortality due to non-COVID-19-related illnesses. The declines have been sustained. Recent data suggests a reversal in trends with services appearing to be going back to pre- COVID levels.

Dataset Information

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data.

Background

Methods

Results

Conclusion

Trial registration

Publications

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets