Dataset Information

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial.

ABSTRACT: Background:Countries across sub-Saharan Africa are scaling up Community Health Worker (CHW) programmes, yet there remains little high-quality research assessing strategies for CHW supervision and performance improvement. This randomised controlled trial aimed to determine the effect of a personalised performance dashboard used as a supervision tool on the quantity, speed, and quality of CHW care. Methods:We conducted a randomised controlled trial in a large health catchment area in peri-urban Mali. One hundred forty-eight CHWs conducting proactive case-finding home visits were randomly allocated to receive individual monthly supervision with or without the CHW Performance Dashboard from January to June 2016. Randomisation was stratified by CHW supervisor, level of CHW experience, and CHW baseline performance for monthly quantity of care (number of household visits). With regression analysis, we used a difference-in-difference model to estimate the effect of the intervention on monthly quantity, timeliness (percentage of children under five treated within 24 hours of symptom onset), and quality (percentage of children under five treated without protocol error) of care over a six-month post-intervention period relative to a three-month pre-intervention period. Results:Use of the Dashboard during monthly supervision significantly increased the mean number of home visits by 39.94 visits per month (95% CI?=?3.56-76.3; P?=?0.031). Estimated effects on secondary outcomes of timeliness and quality were positive but not statistically significant. Across both study arms, CHW quantity, timeliness, and quality of care significantly improved over the study period, during which time all CHWs received dedicated monthly supervision, although effects plateaued over time. Conclusions:Our findings suggest that dedicated monthly supervision and personalised feedback using performance dashboards can increase CHW productivity. Further operational research is needed to understand how to sustain the performance improvements over time. Trial registration:ClinicalTrials.gov (NCT03684551).

SUBMITTER: Whidden C

PROVIDER: S-EPMC6162089 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial.

Whidden Caroline C Kayentao Kassoum K Liu Jenny X JX Lee Scott S Keita Youssouf Y Diakité Djoumé D Keita Alexander A Diarra Samba S Edwards Jacqueline J Yembrick Amanda A Holeman Isaac I Samaké Salif S Plea Boureima B Coumaré Mama M Johnson Ari D AD

Journal of global health 20181201 2

<h4>Background</h4>Countries across sub-Saharan Africa are scaling up Community Health Worker (CHW) programmes, yet there remains little high-quality research assessing strategies for CHW supervision and performance improvement. This randomised controlled trial aimed to determine the effect of a personalised performance dashboard used as a supervision tool on the quantity, speed, and quality of CHW care.<h4>Methods</h4>We conducted a randomised controlled trial in a large health catchment area i ...[more]

PMID: 30333922

Similar Datasets

Project description:BackgroundIf trained, equipped and utilised, community health workers (CHWs) delivering integrated community case management for sick children can potentially reduce child deaths by 60%. However, it is essential to maintain CHW motivation and performance. The inSCALE project aims to evaluate, using a cluster randomised controlled trial, the effect of interventions to increase CHW supervision and performance on the coverage of appropriate treatment for children with diarrhoea, pneumonia and malaria.Methods/designParticipatory methods were used to identify best practices and innovative solutions. Quantitative community based baseline surveys were conducted to allow restricted randomisation of clusters into intervention and control arms. Individual informed consent was obtained from all respondents. Following formative research and stakeholder consultations, two intervention packages were developed in Uganda and one in Mozambique. In Uganda, approximately 3,500 CHWs in 39 clusters were randomised into a mobile health (mHealth) arm, a participatory community engagement arm and a control arm. In Mozambique, 275 CHWs in 12 clusters were randomised into a mHealth arm and a control arm. The mHealth interventions encompass three components: 1) free phone communication between users; 2) data submission using phones with automated feedback, messages to supervisors for targeted supervision, and online data access for district statisticians; and 3) motivational messages. The community engagement arm in Uganda established village health clubs seeking to 1) improve the status and standing of CHWs, 2) increase demand for health services and 3) communicate that CHWs' work is important. Process evaluation was conducted after 10 months and end-line surveys will establish impact after 12 months in Uganda and 18 months in Mozambique. Main outcomes include proportion of sick children appropriately treated, CHW performance and motivation, and cost effectiveness of interventions.DiscussionStudy strengths include a user-centred design to the innovations, while weaknesses include the lack of a robust measurement of coverage of appropriate treatment. Evidence of cost-effective innovations that increase motivation and performance of CHWs can potentially increase sustainable coverage of iCCM at scale.Trial registration(identifier NCT01972321 ) on 22 April 22 2013.

Project description:The inSCALE cluster randomised controlled trial in Uganda evaluated two interventions, mHealth and Village Health Clubs (VHCs) which aimed to improve Community Health Worker (CHW) treatment for malaria, diarrhoea, and pneumonia within the national Integrated Community Case Management (iCCM) programme. The interventions were compared with standard care in a control arm. In a cluster randomised trial, 39 sub-counties in Midwest Uganda, covering 3167 CHWs, were randomly allocated to mHealth; VHC or usual care (control) arms. Household surveys captured parent-reported child illness, care seeking and treatment practices. Intention-to-treat analysis estimated the proportion of appropriately treated children with malaria, diarrhoea, and pneumonia according to WHO informed national guidelines. The trial was registered at ClinicalTrials.gov (NCT01972321). Between April-June 2014, 7679 households were surveyed; 2806 children were found with malaria, diarrhoea, or pneumonia symptoms in the last one month. Appropriate treatment was 11% higher in the mHealth compared to the control arm (risk ratio [RR] 1.11, 95% CI 1.02, 1.21; p = 0.018). The largest effect was on appropriate treatment for diarrhoea (RR 1.39; 95% CI 0.90, 2.15; p = 0.134). The VHC intervention increased appropriate treatment by 9% (RR 1.09; 95% CI 1.01, 1.18; p = 0.059), again with largest effect on treatment of diarrhoea (RR 1.56, 95% CI 1.04, 2.34, p = 0.030). CHWs provided the highest levels of appropriate treatment compared to other providers. However, improvements in appropriate treatment were observed at health facilities and pharmacies, with CHW appropriate treatment the same across the arms. The rate of CHW attrition in both intervention arms was less than half that of the control arm; adjusted risk difference mHealth arm -4.42% (95% CI -8.54, -0.29, p = 0.037) and VHC arm -4.75% (95% CI -8.74, -0.76, p = 0.021). Appropriate treatment by CHWs was encouragingly high across arms. The inSCALE mHealth and VHC interventions have the potential to reduce CHW attrition and improve the care quality for sick children, but not through improved CHW management as we had hypothesised. Trial Registration:ClinicalTrials.gov (NCT01972321).

Project description:BackgroundThe strength of a health system-and ultimately the health of a population-depends to a large degree on health worker performance. However, insufficient support to build, manage and optimize human resources for health (HRH) in low- and middle-income countries (LMICs) results in inadequate health workforce performance, perpetuating health inequities and low-quality health services.MethodsThe USAID-funded Human Resources for Health in 2030 Program (HRH2030) conducted a systematic review of studies documenting supervision enhancements and approaches that improved health worker performance to highlight components associated with these interventions' effectiveness. Structured by a conceptual framework to classify the inputs, processes, and results, the review assessed 57 supervision studies since 2010 in approximately 29 LMICs.ResultsOf the successful supervision approaches described in the 57 studies reviewed, 44 were externally funded pilots, which is a limitation. Thirty focused on community health worker (CHW) programs. Health worker supervision was informed by health system data for 38 approaches (67%) and 22 approaches used continuous quality improvement (QI) (39%). Many successful approaches integrated digital supervision technologies (e.g., SmartPhones, mHealth applications) to support existing data systems and complement other health system activities. Few studies were adapted, scaled, or sustained, limiting reports of cost-effectiveness or impact.ConclusionBuilding on results from the review, to increase health worker supervision effectiveness we recommend to: integrate evidence-based, QI tools and processes; integrate digital supervision data into supervision processes; increase use of health system information and performance data when planning supervision visits to prioritize lowest-performing areas; scale and replicate successful models across service delivery areas and geographies; expand and institutionalize supervision to reach, prepare, protect, and support frontline health workers, especially during health emergencies; transition and sustain supervision efforts with domestic human and financial resources, including communities, for holistic workforce support. In conclusion, effective health worker supervision is informed by health system data, uses continuous quality improvement (QI), and employs digital technologies integrated into other health system activities and existing data systems to enable a whole system approach. Effective supervision enhancements and innovations should be better integrated, scaled, and sustained within existing systems to improve access to quality health care.

Project description:Supportive supervision is an important element of community health worker (CHW) programmes and is believed to improve CHW motivation and performance. A group supervision intervention, which included training and mentorship of supervisors, was implemented in Ethiopia, Kenya, Malawi and Mozambique. In three of the countries, this was combined with individual and/or peer supervision. A mixed-methods implementation study was conducted to assess the effect of the supervision intervention on CHWs' perceptions of supervision and CHW motivation-related outcomes. In total, 153 in-depth interviews were conducted with CHWs, their supervisors and managers. In addition, questionnaires assessing perceived supervision and motivation-related outcomes (organizational and community commitment, job satisfaction and conscientiousness) were administered to a total of 278 CHWs pre- and post-intervention, and again after 1 year. Interview transcripts were thematically analysed using a coding framework. Changes in perceived supervision and motivation-related outcomes were assessed using Friedman's ANOVA and post hoc Wilcoxon signed-rank tests. Interview participants reported that the supervision intervention improved CHW motivation. In contrast, the quantitative survey found no significant changes for measures of perceived supervision and inconsistent changes in motivation-related outcomes. With regard to the process of supervision, the problem-solving focus, the sense of joint responsibilities and team work, cross-learning and skill sharing, as well as the facilitating and coaching role of the supervisor, were valued. The empowerment and participation of supervisees in decision making also emerged in the analysis, albeit to a lesser extent. Although qualitative and quantitative findings differed, which could be related to the slightly different focus of methods used and a 'ceiling effect' limiting the detection of observable differences from the survey, the study suggests that there is potential for integrating supportive group supervision models in CHW programmes. A combination of group with individual or peer supervision, preferably accompanied with methods that assess CHW performance and corresponding feedback systems, could yield improved motivation and performance.

Project description:BackgroundLow levels of physical activity are a major public health concern, and interventions to promote physical activity have had limited success. Whether or not personalised feedback about physical activity following objective measurement motivates behaviour change has yet to be rigorously examined.MethodsAnd Findings: In a parallel group, open randomised controlled trial, 466 healthy adults aged 32 to 54 years were recruited from the ongoing population-based Fenland Study (Cambridgeshire, UK). Participants were randomised to receive either no feedback until the end of the trial (control group, n=120) or one of three different types of feedback: simple, visual, or contextualised (intervention groups, n=346). The primary outcome was physical activity (physical activity energy expenditure (PAEE) in kJ/kg/day and average body acceleration (ACC) in m/s(2)) measured objectively using a combined heart rate monitor and accelerometer (Actiheart(®)). The main secondary outcomes included self-reported physical activity, intention to increase physical activity, and awareness of physical activity (the agreement between self-rated and objectively measured physical activity). At 8 weeks, 391 (83.9%) participants had complete physical activity data. The intervention had no effect on objectively measured physical activity (PAEE: ?=-0.92, 95% CI=-3.50 to 1.66, p=0.48 and ACC: ?=0.01, 95% CI=-0.00 to 0.02, p=0.21), self-reported physical activity (?=-0.39, 95% CI=-1.59 to 0.81), or intention to increase physical activity (?=-0.05, 95% CI=-0.22 to 0.11). However, it was associated with an increase in awareness of physical activity (OR=1.74, 95% CI=1.05 to 2.89). Results did not differ according to the type of feedback.ConclusionsPersonalised feedback about physical activity following objective measurement increased awareness but did not result in changes in physical activity in the short term. Measurement and feedback may have a role in promoting behaviour change but are ineffective on their own.Trial registrationCurrent Controlled Trials ISRCTN92551397 http://www.controlled-trials.com/ISRCTN92551397.

Project description:BackgroundEvidence-based treatments for child mental health problems are not consistently available in public mental health settings. Expanding availability requires workforce training. However, research has demonstrated that training alone is not sufficient for changing provider behavior, suggesting that ongoing intervention-specific supervision or consultation is required. Supervision is notably under-investigated, particularly as provided in public mental health. The degree to which supervision in this setting includes 'gold standard' supervision elements from efficacy trials (e.g., session review, model fidelity, outcome monitoring, skill-building) is unknown. The current federally-funded investigation leverages the Washington State Trauma-focused Cognitive Behavioral Therapy Initiative to describe usual supervision practices and test the impact of systematic implementation of gold standard supervision strategies on treatment fidelity and clinical outcomes.Methods/designThe study has two phases. We will conduct an initial descriptive study (Phase I) of supervision practices within public mental health in Washington State followed by a randomized controlled trial of gold standard supervision strategies (Phase II), with randomization at the clinician level (i.e., supervisors provide both conditions). Study participants will be 35 supervisors and 130 clinicians in community mental health centers. We will enroll one child per clinician in Phase I (N = 130) and three children per clinician in Phase II (N = 390). We use a multi-level mixed within- and between-subjects longitudinal design. Audio recordings of supervision and therapy sessions will be collected and coded throughout both phases. Child outcome data will be collected at the beginning of treatment and at three and six months into treatment.DiscussionThis study will provide insight into how supervisors can optimally support clinicians delivering evidence-based treatments. Phase I will provide descriptive information, currently unavailable in the literature, about commonly used supervision strategies in community mental health. The Phase II randomized controlled trial of gold standard supervision strategies is, to our knowledge, the first experimental study of gold standard supervision strategies in community mental health and will yield needed information about how to leverage supervision to improve clinician fidelity and client outcomes.Trial registrationClinicalTrials.gov NCT01800266.

Dataset Information

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial.

Publications

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets