Dataset Information

Phone-based monitoring to evaluate health policy and program implementation in Kenya.

ABSTRACT: Monitoring and evaluating policies and programs in low- and middle-income countries are often difficult because of the lack of routine data. High mobile phone ownership in these countries presents an opportunity for efficient data collection through telephone interviews. This study examined the feasibility of collecting data on medicines through telephone interviews in Kenya. Data on the availability and prices of medicines at 137 health facilities and 639 patients were collected in September 2016 via in-person interviews. Between December 2016 and December 2017, monthly telephone interviews were conducted with health facilities and patients. An unannounced in-person interview was conducted with respondents to validate the telephone interview within 24 h. A bottom-up itemization costing approach was used to estimate the costs of telephone and in-person data collection. In-depth interviews were conducted with data collectors and respondents to explore their perceptions on both modes of data collection. The level of agreement between data on medicines availability collected through phone and in-person interviews was strong at the health facility level [kappa = 0.90; confidence interval (CI) 0.88-0.92] and moderate at the household level (kappa = 0.50, CI 0.39-0.60). Price data from telephone and in-person interviews showed strong intra-class correlation at health facilities [intra-class correlation coefficient (ICC) = 0.96] and moderate intra-class correlation at households (ICC = 0.47). The cost per phone interview at health facilities and households were $19.73 and $16.86, respectively, compared to $186.20 for a baseline in-person interview. Participants considered telephone interviews to be more convenient. In countries with high cell phone penetration, telephone data collection should be considered in monitoring and evaluating public health programs especially at health facilities. Additional strategies may be needed to optimize this mode of data collection at the household level. Variations in cell phone ownership, telecommunication network and data collection costs across different settings may limit the generalizability of the findings from this study.

SUBMITTER: Ashigbie PG

PROVIDER: S-EPMC8128015 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe monitoring and evaluation of public health programs based on traditional face-to-face interviews in hard-to-reach and unstable regions present many challenges. Mobile phone-based methods are considered to be an effective alternative, but the validity of mobile phone-based data for assessing implementation strength has not been sufficiently studied yet. Nested within an evaluation project for an integrated community case management (iCCM) and family planning program in Mali, this study aimed to assess the validity of a mobile phone-based health provider survey to measure the implementation strength of this program.MethodsFrom July to August 2018, a cross-sectional survey was conducted among the community health workers (ASCs) from six rural districts working with the iCCM and family planning program. ASCs were first reached to complete the mobile phone-based survey; within a week, ASCs were visited in their communities to complete the in-person survey. Both surveys used identical implementation strength tools to collect data on program activities related to iCCM and family planning. Sensitivity and specificity were calculated for each implementation strength indicator collected from the phone-based survey, with the in-person survey as the gold standard. A threshold of ≥ 80% for sensitivity and specificity was considered adequate for evaluation purposes.ResultsOf the 157 ASCs interviewed by mobile phone, 115 (73.2%) were reached in person. Most of the training (2/2 indicators), supervision (2/3), treatment/modern contraceptive supply (9/9), and reporting (3/3) indicators reached the 80% threshold for sensitivity, while only one supervision indicator and one supply indicator reached 80% for specificity. In contrast, most of the stock-out indicators (8/9) reached 80% for specificity, while only two indicators reached the threshold for sensitivity.ConclusionsThe validity of mobile phone-based data was adequate for general training, supervision, and supply indicators for iCCM and family planning. With sufficient mobile phone coverage and reliable mobile network connection, mobile phone-based surveys are useful as an alternative for data collection to assess the implementation strength of general activities in hard-to-reach areas.

Project description:BackgroundThere has been an international shift in health care, which has seen an increasing focus and development of technological and personalized at-home interventions that aim to improve health outcomes and patient-clinician communication. However, there is a notable lack of empirical evidence describing the preparatory steps of adapting and implementing technology of this kind across multiple countries and clinical settings.ObjectiveThis study aimed to describe the steps undertaken in the preparation of a multinational, multicenter randomized controlled trial (RCT) to test a mobile phone-based remote symptom monitoring system, that is, Advanced Symptom Management System (ASyMS), designed to enhance management of chemotherapy toxicities among people with cancer receiving adjuvant chemotherapy versus standard cancer center care.MethodsThere were 13 cancer centers across 5 European countries (Austria, Greece, Ireland, Norway, and the United Kingdom). Multiple steps were undertaken, including a scoping review of empirical literature and clinical guidelines, translation and linguistic validation of study materials, development of standardized international care procedures, and the integration and evaluation of the technology within each cancer center.ResultsThe ASyMS was successfully implemented and deployed in clinical practices across 5 European countries. The rigorous and simultaneous steps undertaken by the research team highlighted the strengths of the system in clinical practice, as well as the clinical and technical changes required to meet the diverse needs of its intended users within each country, before the commencement of the RCT.ConclusionsAdapting and implementing this multinational, multicenter system required close attention to diverse considerations and unique challenges primarily related to communication and clinical and technical issues. Success was dependent on collaborative and transparent communication among academics, the technology industry, translation partners, patients, and clinicians as well as a simultaneous and rigorous methodological approach within the 5 relevant countries.

Project description:BackgroundGlobal interest and investment in close-to-community health services is increasing. Kenya is currently revising its community health strategy (CHS) alongside political devolution, which will result in revisioning of responsibility for local services. This article aims to explore drivers of policy change from key informant perspectives and to study perceptions of current community health services from community and sub-county levels, including perceptions of what is and what is not working well. It highlights implications for managing policy change.MethodsWe conducted 40 in-depth interviews and 10 focus group discussions with a range of participants to capture plural perspectives, including those who will influence or be influenced by CHS policy change in Kenya (policymakers, sub-county health management teams, facility managers, community health extension worker (CHEW), community health workers (CHWs), clients and community members) in two purposively selected counties: Nairobi and Kitui. Qualitative data were digitally recorded, transcribed, translated and coded before framework analysis.ResultsThere is widespread community appreciation for the existing strategy. High attrition, lack of accountability for voluntary CHWs and lack of funds to pay CHW salaries, combined with high CHEW workload were seen as main drivers for strategy change. Areas for change identified include: lack of clear supervisory structure including provision of adequate travel resources, current uneven coverage and equity of community health services, limited community knowledge about the strategy revision and demand for home-based HIV testing and counselling.ConclusionThis in-depth analysis which captures multiple perspectives results in robust recommendations for strategy revision informed by the Five Wonders of Change Framework. These recommendations point towards a more people-centred health system for improved equity and effectiveness and indicate priority areas for action if success of policy change through the roll-out of the revised strategy is to be realized.

Project description:BackgroundThe Fogarty International Center (FIC) has supported research capacity development for over twenty years. While the mission of FIC is supporting and facilitating global health research conducted by U.S. and international investigators, building partnerships between health research institutions in the U.S. and abroad, and training the next generation of scientists to address global health needs, research capacity may impact health policies and programs and therefore have positive impacts on public health. We conducted an exploratory analysis of how FIC research training investments affected public health policy and program development in Kenya and Uganda.MethodsWe explored the long term impacts of all FIC supported research training programs using case studies, in Kenya and Uganda. Semi-structured in-depth interviews were conducted with 53 respondents and 29 focus group discussion participants across the two countries. Qualitative methods were supplemented by structured surveys of trainees and document review, including a review of evidence cited in policy documents.ResultsIn the primary focal areas of FIC grants, notably HIV/AIDS, there were numerous examples of work conducted by former FIC trainees that influenced national and global policies. Facilitators for this influence included the strong technical skills and scientific reputations of the trainees, and professional networks spanning research and policy communities. Barriers included the fact that trainees typically had not received training in research communication, relatively few policy makers had received scientific training, and institutional constraints that undermined alignment of research with policy needs.ConclusionsWhile FIC has not focused its programs on the goal of policy and program influence, its investments have affected global and national public health policies and practice. These influences have occurred primarily through strengthening research skills of scientists and developing strong in-country networks. Further success of FIC and similar initiatives could be stimulated by investing more in the training of policy-makers, seeking to better align research with policy needs through more grants that are awarded directly to developing country institutions, and grants that better incorporate policy maker perspectives in their design and governance. Addressing structural constraints, for example supporting the development of national research agendas that inform university research, would further support such efforts.

Dataset Information

Phone-based monitoring to evaluate health policy and program implementation in Kenya.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets