Dataset Information

A realist systematic review of evidence from low- and middle-income countries of interventions to improve immunization data use.

ABSTRACT:

Background

The use of routine immunization data by health care professionals in low- and middle-income countries remains an underutilized resource in decision-making. Despite the significant resources invested in developing national health information systems, systematic reviews of the effectiveness of data use interventions are lacking. Applying a realist review methodology, this study synthesized evidence of effective interventions for improving data use in decision-making.

Methods

We searched PubMed, POPLINE, Centre for Agriculture and Biosciences International Global Health, and African Journals Online for published literature. Grey literature was obtained from conference, implementer, and technical agency websites and requested from implementing organizations. Articles were included if they reported on an intervention designed to improve routine data use or reported outcomes related to data use, and targeted health care professionals as the principal data users. We developed a theory of change a priori for how we expect data use interventions to influence data use. Evidence was then synthesized according to data use intervention type and level of the health system targeted by the intervention.

Results

The searches yielded 549 articles, of which 102 met our inclusion criteria, including 49 from peer-reviewed journals and 53 from grey literature. A total of 66 articles reported on immunization data use interventions and 36 articles reported on data use interventions for other health sectors. We categorized 68 articles as research evidence and 34 articles as promising strategies. We identified ten primary intervention categories, including electronic immunization registries, which were the most reported intervention type (n = 14). Among the research evidence from the immunization sector, 32 articles reported intermediate outcomes related to data quality and availability, data analysis, synthesis, interpretation, and review. Seventeen articles reported data-informed decision-making as an intervention outcome, which could be explained by the lack of consensus around how to define and measure data use.

Conclusions

Few immunization data use interventions have been rigorously studied or evaluated. The review highlights gaps in the evidence base, which future research and better measures for assessing data use should attempt to address.

SUBMITTER: Osterman AL

PROVIDER: S-EPMC8268169 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundImproving health workers' performance is vital for achieving the Millennium Development Goals. In the literature on human resource management (HRM) interventions to improve health workers' performance in Low and Middle Income Countries (LMIC), hardly any attention has been paid to the question how HRM interventions might bring about outcomes and in which contexts. Such information is, however, critical to assess the transferability of results. Our aim was to explore if realist review of published primary research provides better insight into the functioning of HRM interventions in LMIC.MethodologyA realist review not only asks whether an intervention has shown to be effective, but also through which mechanisms an intervention produces outcomes and which contextual factors appear to be of critical influence. Forty-eight published studies were reviewed.ResultsThe results show that HRM interventions can improve health workers' performance, but that different contexts produce different outcomes. Critical implementation aspects were involvement of local authorities, communities and management; adaptation to the local situation; and active involvement of local staff to identify and implement solutions to problems. Mechanisms that triggered change were increased knowledge and skills, feeling obliged to change and health workers' motivation. Mechanisms to contribute to motivation were health workers' awareness of local problems and staff empowerment, gaining acceptance of new information and creating a sense of belonging and respect. In addition, staff was motivated by visible improvements in quality of care and salary supplements. Only a limited variety of HRM interventions have been evaluated in the health sector in LMIC. Assumptions underlying HRM interventions are usually not made explicit, hampering our understanding of how HRM interventions work.ConclusionApplication of a realist perspective allows identifying which HRM interventions might improve performance, under which circumstances, and for which groups of health workers. To be better able to contribute to an understanding of how HRM interventions could improve health workers' performance, a combination of qualitative and quantitative research methods would be needed and the use of common indicators for evaluation and a common reporting format would be required.

Project description:Maternal mortality is disproportionately higher in low- and middle-income countries compared to other parts of the world. International research efforts are reflective of the urgency to improve global maternal outcomes. The existing literature of maternal health interventions in low- and middle-income countries targets a variety of populations and intervention types. However, there is a notable lack of systemic reviews that examine the wider contextual and mechanistic factors that have contributed to the outcomes produced by interventions. This article aims to use realist synthesis design to identify and examine the relationships between the contexts, mechanisms and outcomes of maternal health interventions conducted in low- and middle-income countries. This will inform evidence-based practice for future maternal health interventions. In May 2022, we searched four electronic databases for systematic reviews of maternal health interventions in low- and middle-income countries published in the last 5 years. We used open and axial coding of contexts, mechanisms and outcomes to develop an explanatory framework for intervention effectiveness. After eligibility screening and full-text analysis, 44 papers were included. The majority of effective interventions reported good healthcare system contexts, especially the importance of infrastructural capacity to implement and sustain the intervention. Most intervention designs used increasing knowledge and awareness at an individual and healthcare-provider level to produce intended outcomes. The majority of outcomes reported related to uptake of healthcare services by women. All mechanism themes had a relationship with this outcome. Health system infrastructure must be considered in interventions to ensure effective implementation and sustainability. Healthcare-seeking behaviours are embedded within social and cultural norms, environmental conditions, family influences and provider attitudes. Therefore, effective engagement with communities and families is important to create new norms surrounding pregnancy and delivery. Future research should explore community mobilization and involvement to enable tailored interventions with optimal contextual fit.

Project description:ObjectiveTo support evidence informed decision-making, we systematically examine the effectiveness and cost-effectiveness of community engagement interventions on routine childhood immunisation outcomes in low-income and middle-income countries (LMICs) and identify contextual, design and implementation features associated with effectiveness.DesignMixed-methods systematic review and meta-analysis.Data sources21 databases of academic and grey literature and 12 additional websites were searched in May 2019 and May 2020.Eligibility criteria for selecting studiesWe included experimental and quasi-experimental impact evaluations of community engagement interventions considering outcomes related to routine child immunisation in LMICs. No language, publication type, or date restrictions were imposed.Data extraction and synthesisTwo independent researchers extracted summary data from published reports and appraised quantitative risk of bias using adapted Cochrane tools. Random effects meta-analysis was used to examine effects on the primary outcome, full immunisation coverage.ResultsOur search identified over 43 000 studies and 61 were eligible for analysis. The average pooled effect of community engagement interventions on full immunisation coverage was standardised mean difference 0.14 (95% CI 0.06 to 0.23, I2=94.46). The most common source of risk to the quality of evidence (risk of bias) was outcome reporting bias: most studies used caregiver-reported measures of vaccinations received by a child in the absence or incompleteness of immunisation cards. Reasons consistently cited for intervention success include appropriate intervention design, including building in community engagement features; addressing common contextual barriers of immunisation and leveraging facilitators; and accounting for existing implementation constraints. The median intervention cost per treated child per vaccine dose (excluding the cost of vaccines) to increase absolute immunisation coverage by one percent was US$3.68.ConclusionCommunity engagement interventions are successful in improving outcomes related to routine child immunisation. The findings are robust to exclusion of studies assessed as high risk of bias.

Project description:Novel vaccine development and production has given rise to a growing number of vaccines that can prevent disease and save lives. In order to realize these health benefits, it is essential to ensure adequate immunization financing to enable equitable access to vaccines for people in all communities. This analysis estimates the full immunization program costs, projected available financing, and resulting funding gap for 94 low- and middle-income countries over five years (2016-2020). Vaccine program financing by country governments, Gavi, and other development partners was forecasted for vaccine, supply chain, and service delivery, based on an analysis of comprehensive multi-year plans together with a series of scenario and sensitivity analyses. Findings indicate that delivery of full vaccination programs across 94 countries would result in a total funding gap of $7.6 billion (95% uncertainty range: $4.6-$11.8 billion) over 2016-2020, with the bulk (98%) of the resources required for routine immunization programs. More than half (65%) of the resources to meet this funding gap are required for service delivery at $5.0 billion ($2.7-$8.4 billion) with an additional $1.1 billion ($0.9-$2.7 billion) needed for vaccines and $1.5 billion ($1.1-$2.0 billion) for supply chain. When viewed as a percentage of total projected costs, the funding gap represents 66% of projected supply chain costs, 30% of service delivery costs, and 9% of vaccine costs. On average, this funding gap corresponds to 0.2% of general government expenditures and 2.3% of government health expenditures. These results suggest greater need for country and donor resource mobilization and funding allocation for immunizations. Both service delivery and supply chain are important areas for further resource mobilization. Further research on the impact of advances in service delivery technology and reductions in vaccine prices beyond this decade would be important for efficient investment decisions for immunization.

Project description:IntroductionEngaging communities and intended beneficiaries at various stages of health research is a recommended practice. The contribution of community engagement to non-communicable disease research in low- and middle-income countries has not yet been extensively studied or synthesised. This protocol describes the steps towards generating an understanding of community engagement in the context of non-communicable disease research, prevention and health promotion using a realist review approach. A realist lens enables a rich explanatory approach to causation while capturing complexity, and an openness to multiple outcomes, including unintended consequences. The review will thus develop an understanding of community engagement without assuming that such practices result in more ethical research or effective interventions.Methods and analysisWe propose a realist approach aiming to examine how, why, under what circumstances and for whom community engagement works or does not work. The iterative review steps include clarifying the review scope; searching for evidence; appraising studies and extracting data; synthesising evidence and drawing conclusions; and disseminating, implementing and evaluating the findings. Principles of meta-narrative review (pragmatism, pluralism, historicity, contestation, reflexivity and peer review) are employed to ensure practicable and contextualised review outputs. The proposed review will draw on theoretical and empirical literature beyond specific diseases or settings, but with a focus on informing non-communicable disease research and interventions in low- and middle-income countries. The synthesis of existing literature will be complemented by qualitative realist interviews and stakeholder consultation. Through drawing on multiple types of evidence and input from both experts and intended beneficiaries, the review will provide critical and pragmatic insights for research and community engagement in low- and middle-income countries.Ethics and disseminationEthical approval has been obtained from the University of the Witwatersrand. Dissemination will include traditional academic channels, institutional communications, social media and discussions with a wide range of stakeholders.

Project description:BackgroundA key constraint to saturating coverage of interventions for reducing the burden of childhood illnesses in Low and Middle Income Countries (LMIC) is the lack of human resources. Community health workers (CHW) are potentially important actors in bridging this gap. Evidence exists on effectiveness of CHW in management of some childhood illnesses (IMCI). However, we need to know how and when this comes to be. We examine evidence from randomized control trials (RCT) on CHW interventions in IMCI in LMIC from a realist perspective with the aim to see if they can yield insight into the working of the interventions, when examined from a different perspective.MethodsThe realist approach involves educing the mechanisms through which an intervention produced an outcome in a particular context. 'Mechanisms' are reactions, triggered by the interaction of the intervention and a certain context, which lead to change. These are often only implicit and are actually hypothesized by the reviewer. This review is limited to unravelling these from the RCTs; it is thus a hypothesis generating exercise.ResultsInterventions to improve CHW performance included 'Skills based training of CHW', 'Supervision and referral support from public health services', 'Positioning of CHW in the community'. When interventions were applied in context of CHW programs embedded in local health services, with beneficiaries who valued services and had unmet needs, the interventions worked if following mechanisms were triggered: anticipation of being valued by the community; perception of improvement in social status; sense of relatedness with beneficiaries and public services; increase in self esteem; sense of self efficacy and enactive mastery of tasks; sense of credibility, legitimacy and assurance that there was a system for back-up support. Studies also showed that if context differed, even with similar interventions, negative mechanisms could be triggered, compromising CHW performance.ConclusionThe aim of this review was to explore if RCTs could yield insight into the working of the interventions, when examined from a different, a realist perspective. We found that RCTs did yield some insight, but the hypotheses generated were very general and not well refined. These hypotheses need to be tested and refined in further studies.

Project description:IntroductionHealth systems responsiveness is a key objective of any health system, yet it is the least studied of all objectives particularly in low-income and middle-income countries. Research on health systems responsiveness highlights its multiple elements, for example, dignity and confidentiality. Little is known, however, about underlying theories of health systems responsiveness, and the mechanisms through which responsiveness works. This realist synthesis contributes to bridging these two knowledge gaps.Methods and analysisIn this realist synthesis, we will use a four-step process, comprising: mapping of theoretical bases, formulation of programme theories, theory refinement and testing of programme theories using literature and empirical data from Ghana and Vietnam. We will include theoretical and conceptual pieces, reviews, empirical studies and grey literature, alongside the primary data. We will explore responsiveness as entailing external and internal interactions within health systems. The search strategy will be purposive and iterative, with continuous screening and refinement of theories. Data extraction will be combined with quality appraisal, using appropriate tools. Each fragment of evidence will be appraised as it is being extracted, for its relevance to the emerging programme theories and methodological rigour. The extracted data pertaining to contexts, mechanisms and outcomes will be synthesised to identify patterns and contradictions. Results will be reported using narrative explanations, following established guidance on realist syntheses.Ethics and disseminationEthics approvals for the wider RESPONSE (Improving health systems responsiveness to neglected health needs of vulnerable groups in Ghana and Vietnam) study, of which this review is one part, were obtained from the ethics committees of the following institutions: London School of Hygiene and Tropical Medicine (ref: 22981), University of Leeds, School of Medicine (ref: MREC19-051), Ghana Health Service (ref: GHS-ERC 012/03/20) and Hanoi University of Public Health (ref: 020-149/DD-YTCC).We will disseminate results through academic papers, conference presentations and stakeholder workshops in Ghana and Vietnam.Prospero registration numberCRD42020200353. Full record: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020200353.

Project description:Immunisation is one of the most cost-effective interventions to prevent and control life-threatening infectious diseases. Nonetheless, rates of routine vaccination of children in low- and middle-income countries (LMICs) are strikingly low or stagnant. In 2019, an estimated 19.7 million infants did not receive routine immunisations. Community engagement interventions are increasingly being emphasised in international and national policy frameworks as a means to improve immunisation coverage and reach marginalised communities. This systematic review examines the effectiveness and cost-effectiveness of community engagement interventions on outcomes related to childhood immunisation in LMICs and identifies contextual, design and implementation features that may be associated with effectiveness. We identified 61 quantitative and mixed methods impact evaluations and 47 associated qualitative studies related to community engagement interventions for inclusion in the reteview. For cost-effectiveness analysis 14 of the 61 studies had the needed combination of cost and effectiveness data. The 61 included impact evaluations were concentrated in South Asia and Sub-Saharan Africa and spread across 19 LMICs. The review found that community engagement interventions had a small but significant, positive effect on all primary immunisation outcomes related to coverage and their timeliness. The findings are robust to exclusion of studies assessed as high risk of bias. Qualitative evidence indicates appropriate intervention design, including building in community engagement features; addressing common contextual barriers of immunisation and leveraging facilitators; and accounting for existing implementation constraints and practicalities on the ground are consistently cited as reasons for intervention success. Among the studies for which we were able to calculate cost-effectiveness, we find that the median non-vaccine cost per dose of intervention to increase immunisation coverage by 1% was US $3.68. Given the broad scope of the review in terms of interventions and outcomes, there is significant variation in findings. Among the various types of community engagement interventions, those that involve creation of community buy-in or development of new cadres of community-based structures were found to have consistent positive effect on more primary vaccination coverage outcomes than if the engagement is limited to the design or delivery of an intervention or is a combination of the various types. The evidence base for sub-group analysis for female children was sparse (only two studies) and the effect on coverage of both full immunisation and third dose of diphtheria pertussis tetanus for this group was insignificant.

Project description:Adolescent girls are among those at the greatest risk of experiencing intimate partner violence (IPV). Despite adolescence being widely regarded as a window of opportunity to influence attitudes and behaviours related to gender equality, evidence on what works to prevent IPV at this critical stage is limited outside of high-income, school-based settings. Even less is understood about the mechanisms of change in these interventions. We conducted a realist review of primary prevention interventions for adolescent IPV in low- and middle-income countries (LMICs) to synthesise evidence on how they work, for whom, and under which circumstances. The review took place in four iterative stages: 1) exploratory scoping, 2) developing initial programme theory, 3) systematic database search, screening and extraction, and 4) purposive searching and refinement of programme theory. We identified eleven adolescent IPV prevention interventions in LMICs, most of which demonstrated a positive impact on IPV experience and/or perpetration (n = 10). Most interventions (n = 9) implemented school- or community-based interactive peer-group education to transform attitudes and norms around gender and relationships for behaviour change. The central mechanism of change related to gender transformative content prompting adolescents to critically reflect on their attitudes and relationships, leading to a reconceptualisation of their values and beliefs. This central mechanism was supported by two secondary implementation mechanisms: 1) the design and delivery of interventions: interactive, age-appropriate education delivered in peer-groups provided adolescents a safe space to engage with content and build communication skills, and 2) the target group: social norms interventions targeting the wider community created enabling environments supportive of individual change. This review highlights the immense potential of gender transformative interventions during the critical period of adolescence for IPV prevention. Future interventions should consider the broader drivers of adolescent IPV and ensure intersectionality informed approaches to maximise their potential to capitalise on this window of opportunity.

Project description:The increasing prevalence and magnitude of harmful effects of substance use disorders (SUDs) in low- and middle-income countries (LMICs) make it imperative to embrace interventions which are acceptable, feasible, and effective in reducing this burden. Globally, the use of telehealth interventions is increasingly being explored as possible effective approaches in the management of SUDs. Using a scoping review of literature, this article summarizes and evaluates evidence for the acceptability, feasibility, and effectiveness of telehealth interventions for SUDs in LMICs. Searches were conducted in five bibliographic databases: PubMed, Psych INFO, Web of Science, Cumulative Index of Nursing and Allied Professionals and the Cochrane database of systematic review. Studies from LMICs which described a telehealth modality, identified at least one psychoactive substance use among participants, and methods that either compared outcomes using pre- and post-intervention data, treatment versus comparison groups, post-intervention data, behavioral or health outcome, and outcome of either acceptability, feasibility, and/or effectiveness were included. Data is presented in a narrative summary using charts, graphs, and tables. The search produced 39 articles across 14 countries which fulfilled our eligibility criteria over a period of 10 years (2010 to 2020). Research on this topic increased remarkably in the latter five years with the highest number of studies in 2019. The identified studies were heterogeneous in their methods and various telecommunication modalities were used to evaluate substance use disorder, with cigarette smoking as the most assessed. Most studies used quantitative methods. The highest number of included studies were from China and Brazil, and only two studies from Africa assessed telehealth interventions for SUDs. There has been an increasingly significant body of literature which evaluates telehealth interventions for SUDs in LMICs. Overall, telehealth interventions showed promising acceptability, feasibility, and effectiveness for SUDs. This article identifies gaps and strengths and suggests directions for future research.