Dataset Information

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation.

ABSTRACT:

Background

In an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs.

Methods

One sub-district in the North West province was identified for the evaluation. One outreach team comprising ten CHWs maintained both the paper forms and mHealth system to record household data on community-based services. A comparative analysis was done to calculate the correspondence between the paper and phone records. A focus group discussion was conducted with the CHWs. Clinical referrals, data accuracy and supervised visits were compared and analysed for the paper and phone systems.

Results

Compared to the mHealth system where data accuracy was assured, 40% of the CHWs showed a consistently high level (>90% correspondence) of data transfer accuracy on paper. Overall, there was an improvement over time, and by the fifth month, all CHWs achieved a correspondence of 90% or above between phone and paper data. The most common error that occurred was summing the total number of visits and/or activities across the five household activity indicators. Few supervised home visits were recorded in either system and there was no evidence of the team leader following up on the automatic notifications received on their cell phones.

Conclusions

The evaluation emphasizes the need for regular supervision for both systems and rigorous and ongoing assessments of data quality for the paper system. Formalization of a mHealth M&E system for PHC outreach teams delivering community based services could offer greater accuracy of M&E and enhance supervision systems for CHWs.

SUBMITTER: Neupane S

PROVIDER: S-EPMC4150556 | biostudies-literature | 2014 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation.

Neupane Sunisha S Odendaal Willem W Friedman Irwin I Jassat Waasila W Schneider Helen H Doherty Tanya T

BMC medical informatics and decision making 20140809

<h4>Background</h4>In an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs.<h4>Methods</h4>One sub-district in the North West pro ...[more]

PMID: 25106499

Similar Datasets

Project description:Introduction: PIERS on the Move (POM) is a mobile health (mHealth) application developed for a smartphone to support community health workers (CHWs) for identification and management of women at risk of adverse outcomes from pre-eclampsia. POM was implemented as an addition to routine antenatal care by accredited social health activists (ASHAs) and auxiliary nurse midwives (ANMs) during the community level intervention for pre-eclampsia (CLIP) Trial in Karnataka state, India (NCT01911494). The objective of this study was to evaluate the experiences of CHWs of using POM in rural India and their perceptions of acceptability and feasibility of this mHealth intervention. Methods: A posttrial mixed-methods evaluation was designed to measure CHW knowledge and self-efficacy regarding the care of women with pre-eclampsia and perceptions of CHWs on the ease of use and usefulness of POM. A structured survey with open-ended questions was conducted between October and November 2017. The median values on a 5-point Likert scale for knowledge and self-efficacy questions were compared between trial arms by Mann–Whitney U test (p < 0.05 significant). Qualitative analysis was undertaken on NVivo 12 (QSR International, Melbourne, Australia). Results: A total of 48 ASHAs and ANMs were interviewed, including 24 who used POM (intervention arm) and 24 who did not (control arm). Self-reported knowledge and self-efficacy for the care of women with pre-eclampsia did not differ between groups. The qualitative analysis highlighted that health workers who used POM reported improved interactions with women and families in their communities. POM strengthened the role of ASHA as a CHW beyond a “link-worker” accompanying women to health services. With training, the mHealth application was easy to use even for CHWs who did not have much experience with smartphones. Conclusions: Community health workers found the POM app easy to use, useful, and well-received by women and their families. POM did not improve care through increased knowledge but built capacity by increasing the recognition of the ASHA and ANM as critical members of the continuum of antenatal healthcare within their communities. These findings support the important role that mHealth technologies can play in strengthening health systems to reach rural, remote, and marginalized populations to reduce disparities in health.

Project description:BackgroundA pragmatic three-tiered approach to monitor the world's largest antiretroviral treatment (ART) programme was adopted by the South African National Department of Health in 2010. With the rapid expansion of the programme, the limitations of the paper-based register (tier 1) were the catalyst for implementation of the stand-alone electronic register (tier 2), which offers simple digitisation of the paper-based register. This article engages with theory on implementation to identify and contextualise enabling and constraining factors for implementation of the electronic register, to describe experiences and use of the register, and to make recommendations for implementation in similar settings where standardisation of ART monitoring and evaluation has not been achieved.MethodsWe conducted a qualitative evaluation of the roll-out of the register. This comprised twenty in-depth interviews with a diverse sample of stakeholders at facility, sub-district, and district levels of the health system. Facility-level participants were selected across five sub-districts, including one facility per sub-district. Responses were coded and analysed using a thematic approach. An implementation science framework guided interpretation of the data.Results & discussionWe identified the following seven themes: 1) ease of implementation, 2) perceived value of an electronic M&E system, 3) importance of stakeholder engagement, 4) influence of a data champion, 5) operational and logistical factors, 6) workload and role clarity, and 7) importance of integrating the electronic register with routine facility monitoring and evaluation. Interpreting our findings through an implementation theory enabled us to construct the scaffolding for implementation across the five facility-settings. This approach illustrated that implementation was not a linear process but occurred at two nodes: at the adoption of the register for roll-out, and at implementation at facility-level.ConclusionIn this study we found that relative advantage of an intervention and stakeholder engagement are critical to implementation. We suggest that without these aspects of implementation, formative and summative outcomes of implementation at both the adoption and coalface stages of implementation would be negatively affected.

Project description:BACKGROUND:Access to qualitative and equitable healthcare is a major challenge in Mauritania. In order to support the country's efforts, a health sector strengthening programme was set up with participatory action research at its core. Reinforcing a health system requires a customised and comprehensive approach to face the complexity inherent to health systems. Yet, limited knowledge is available on how policies could enhance the performance of the system and how multi-stakeholder efforts could give rise to changes in health policy. We aimed to analyse the ongoing participatory action research and, more specifically, see in how far action research as an embedded research approach could contribute to strengthening health systems. METHODS:We adopted a single-case study design, based on two subunits of analysis, i.e., two selected districts. Qualitative data were collected by analysing country and programme documents, conducting 12 semi-structured interviews and performing participatory observations. Interviewees were selected based on their current position and participation in the programme. The data analysis was designed to address the objectives of the study, but evolved according to emerging insights and through triangulation and identification of emergent and/or recurrent themes along the process. RESULTS:An evaluation of the progress made in the two districts indicates that continuous capacity-building and empowerment efforts through a participative approach have been key elements to enhance dialogue between, and ownership of, the actors at the local health system level. However, the strong hierarchical structure of the Mauritanian health system and its low level of decentralisation constituted substantial barriers to innovation. Other constraints were sociocultural and organisational in nature. Poor work ethics due to a weak environmental support system played an important role. While aiming for an alignment between the flexible iterative approach of action research and the prevailing national linear planning process is quite challenging, effects on policy formulation and implementation were not observed. An adequate time frame, the engagement of proactive leaders, maintenance of a sustained dialogue and a pragmatic, flexible approach could further facilitate the process of change. CONCLUSION:Our study showcases that the action research approach used in Mauritania can usher local and national actors towards change within the health system strengthening programme when certain conditions are met. An inclusive, participatory approach generates dynamics of engagement that can facilitate ownership and strengthen capacity. Continuous evaluation is needed to measure how these processes can further develop and presume a possible effect at policy level.

Dataset Information

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation.

Background

Methods

Results

Conclusions

Publications

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure