Dataset Information

Methods for evaluating delivery systems for scaling-up malaria control intervention.

ABSTRACT:

Background

Despite increased resources over the past few years the coverage of malaria control interventions is still inadequate to reach national and international targets and achieve the full potential of the interventions to improve population health. One of the reasons for this inadequate coverage of efficacious interventions is the limited understanding of the optimum delivery systems of the interventions in different contexts. Although there have been debates about how to deliver interventions, the methods for evaluating the effectiveness of different delivery systems have rarely been discussed. Delivery of interventions is relatively complex and a thorough evaluation would need to look holistically at multiple steps in the delivery process and at multiple factors influencing the process. A better understanding of the strength of the evidence on delivery system effectiveness is needed in order to optimise delivery of efficacious interventions.

Methods

A literature review was conducted of methods used to evaluate delivery systems for insecticide treated nets, intermittent preventive treatment in pregnant women, and treatment for malaria in children.

Results

The methodology of delivery system evaluations varied. There were inconsistencies between objectives and methods of the evaluations including inappropriate outcome measures and unnecessary controls. There were few examples where the delivery processes were adequately described, or measured. We propose a cross sectional observational study design with attribution of the outcomes to a specific delivery system as an appropriate method for evaluating delivery systems at scale.

Conclusions

The proposed evaluation framework is adaptable to natural experiments at scale, and can be applied using data from routine surveys such as the Demographic and Health Surveys, modified by the addition of one to two questions for each intervention. This framework has the potential to enable wider application of rigorous evaluations and thereby improve the evidence base on which decisions about delivery systems for malaria control and other public health interventions are taken.

SUBMITTER: Webster J

PROVIDER: S-EPMC2895752 | biostudies-literature | 2010 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Methods for evaluating delivery systems for scaling-up malaria control intervention.

Webster Jayne J Chandramohan Daniel D Hanson Kara K

BMC health services research 20100702

<h4>Background</h4>Despite increased resources over the past few years the coverage of malaria control interventions is still inadequate to reach national and international targets and achieve the full potential of the interventions to improve population health. One of the reasons for this inadequate coverage of efficacious interventions is the limited understanding of the optimum delivery systems of the interventions in different contexts. Although there have been debates about how to deliver i ...[more]

PMID: 20594374

Similar Datasets

Project description:The completion of an implementation research project typically signals the end of research. In contrast, the Ghana Health Service has embraced a continuous process of evidence-based programming, wherein each research episode is followed by action and a new program of research that monitors and guides the utilization of lessons learned. This paper reviews the objectives and design of the most recent phase in this process, known as a National Program for Strengthening the Implementation of the Community-based Health Planning and Services (CHPS) Initiative in Ghana (CHPS+).A mixed method evaluation strategy has been launched involving: i) baseline and endline randomized sample surveys with 247 clusters dispersed in 14 districts of the Northern and Volta Regions to assess the difference in difference effect of stepped wedge differential cluster exposure to CHPS+ activities on childhood survival, ii) a monitoring system to assess the association of changes in service system readiness with CHPS+ interventions, and iii) a program of qualitative systems appraisal to gauge stakeholder perceptions of systems problems, reactions to interventions, and perceptions of change. Integrated survey and monitoring data will permit multi-level longitudinal models of impact; longitudinal QSA data will provide data on the implementation process.A process of exchanges, team interaction, and catalytic financing has accelerated the expansion of community-based primary health care in Ghana's Upper East Region (UER). Using two Northern and two Volta Region districts, the UER systems learning concept will be transferred to counterpart districts where a program of team-based peer training will be instituted. A mixed method research system will be used to assess the impact of this transfer of innovation in collaboration with national and regional program management. This arrangement will generate embedded science that optimizes prospects that results will contribute to national CHPS reform policies and action.

Project description:This review aims at providing synthetic information with scientific evidence on the trends in the malaria events from 1960 to 2011, with the hope that it will help policy makers to take informed decisions on public health issues and intervention designs on malaria control towards elimination in both Sub-Sahara Africa and in the People's Republic of China by highlighting the achievements, progress and challenges in research on moving malaria from epidemic status towards elimination. Our findings showed that since 1960, malaria control programmes in most countries have been disjointed and not harmonized. Interestingly, during the last decade, the causal factors of the unprecedented and substantial decline in malaria morbidity and mortality rates in most vulnerable groups in these endemic areas are multifaceted, including not only the spread of malaria and its related effects but also political and financial willingness, commitment and funding by governments and international donors. The benefits of scaling up the impact of malaria coverage interventions, improvement of health system approaches and sustained commitment of stakeholders are highlighted, although considerable efforts are still necessary in Sub-Sahara Africa. Furthermore, novel integrated control strategies aiming at moving malaria from epidemic status to control towards elimination, require solid research priorities both for sustainability of the most efficient existing tools and intervention coverage, and in gaining more insights in the understanding of the epidemiology, pathogenesis, vector dynamics, and socioeconomic aspects of the disease. In conclusion, political commitment and financial investment of stakeholders in sustaining the scaling up impact of malaria control interventions, networking between African and Chinese scientists, and their Western partners are urgently needed in upholding the recent gains, and in translating lessons learnt from the Chinese malaria control achievements and successes into practical interventions in malaria endemic countries in Africa and elsewhere.

Project description:BackgroundSMS for Life was one of the earliest large-scale implementations of mHealth innovations worldwide. Its goal was to increase visibility to antimalarial stock-outs through the use of SMS technology. The objective of this case study was to show the multiple innovations that SMS for Life brought to the Tanzanian public health sector and to discuss the challenges of scaling up that led to its discontinuation from a health systems perspective.MethodsA qualitative case-study approach was used. This included a literature review, a document review of 61 project documents, a timeline of key events and the collection and analysis of 28 interviews with key stakeholders involved in or affected by the SMS for Life programme. Data collection was informed by the health system building blocks. We then carried out a thematic analysis using the WHO mHealth Assessment and Planning for Scale (MAPS) Toolkit as a framework. This served to identify the key reasons for the discontinuation of the programme.ResultsSMS for Life was reliable at scale and raised awareness of stock-outs with real-time monitoring. However, it was discontinued in 2015 after 4 years of a national rollout. The main reasons identified for the discontinuation were the programme's failure to adapt to the continuous changes in Tanzania's health system, the focus on stock-outs rather than ensuring appropriate stock management, and that it was perceived as costly by policy-makers. Despite its discontinuation, SMS for Life, together with co-existing technologies, triggered the development of the capacity to accommodate and integrate future technologies in the health system.ConclusionThis study shows the importance of engaging appropriate stakeholders from the outset, understanding and designing system-responsive interventions appropriately when scaling up and ensuring value to a broad range of health system actors. These shortcomings are common among digital health solutions and need to be better addressed in future implementations.

Project description:BackgroundBehavioral interventions such as psychotherapy are leading, evidence-based practices for a variety of problems (e.g., substance abuse), but the evaluation of provider fidelity to behavioral interventions is limited by the need for human judgment. The current study evaluated the accuracy of statistical text classification in replicating human-based judgments of provider fidelity in one specific psychotherapy--motivational interviewing (MI).MethodParticipants (n?=?148) came from five previously conducted randomized trials and were either primary care patients at a safety-net hospital or university students. To be eligible for the original studies, participants met criteria for either problematic drug or alcohol use. All participants received a type of brief motivational interview, an evidence-based intervention for alcohol and substance use disorders. The Motivational Interviewing Skills Code is a standard measure of MI provider fidelity based on human ratings that was used to evaluate all therapy sessions. A text classification approach called a labeled topic model was used to learn associations between human-based fidelity ratings and MI session transcripts. It was then used to generate codes for new sessions. The primary comparison was the accuracy of model-based codes with human-based codes.ResultsReceiver operating characteristic (ROC) analyses of model-based codes showed reasonably strong sensitivity and specificity with those from human raters (range of area under ROC curve (AUC) scores: 0.62 - 0.81; average AUC: 0.72). Agreement with human raters was evaluated based on talk turns as well as code tallies for an entire session. Generated codes had higher reliability with human codes for session tallies and also varied strongly by individual code.ConclusionTo scale up the evaluation of behavioral interventions, technological solutions will be required. The current study demonstrated preliminary, encouraging findings regarding the utility of statistical text classification in bridging this methodological gap.

Project description:BackgroundInadequate health human resources is a key challenge to advancing child survival in Ghana. Nurses are an essential human resource to target because they represent the largest portion of the health workforce. Building on lessons learned from our pilot pediatric nurse training project and World Health Organization guidelines for transforming and scaling up health professional education, this project aimed to; train 500 pediatric nurse specialists through a one-year training program; develop and integrate a critical mass of pediatric nursing faculty and establish a national standardized pediatric nursing curriculum. This study aimed to evaluate the effectiveness of a national pediatric nurse training program in Ghana at the end of 4 years, including eight cohorts with 330 graduates.MethodsThis was a mixed-method evaluation with surveys, focus groups and a pre-test/post-test design. Before and after surveys were used to measure knowledge and confidence at baseline and graduation. Objective Structured Clinical Examinations (OSCE) were used to measure clinical skills at baseline, graduation, and 14 months follow-up. At the end of every module, surveys were used to measure students' satisfaction. Focus groups at graduation qualitatively measured program outcomes. Repeat focus groups and surveys at 14 months after graduation captured the graduates' career progress, experiences reintegrating into the health system and long-term program outcomes.ResultsOverall, the graduates completed the program with significantly increased knowledge, confidence, and clinical skills. They also had increased job satisfaction and were able to apply what they learned to their jobs, including leadership skills and gender-sensitive care. Data from 14-month follow-up OSCEs showed that all graduates remained competent in communication, physical assessment, and emergency care, although some obtained a lower mark compared to their performance at graduation. This finding is linked with the observation that the amount of mentorship, support from leadership and equipment that the graduates accessed from their respective facilities varied.ConclusionsMixed-methods evaluations demonstrated significant increases in knowledge confidence and skills by completing the program and maintenance of skills more than 1 year after graduation. Findings have implications for those working on the design, implementation, and evaluation of nursing education interventions in low- and middle-income countries.

Dataset Information

Methods for evaluating delivery systems for scaling-up malaria control intervention.

Background

Methods

Results

Conclusions

Publications

Methods for evaluating delivery systems for scaling-up malaria control intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets